2024-08-17T02:14:38.207 INFO:root:teuthology version: 1.2.0 2024-08-17T02:14:38.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:14:38.324 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858256' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:14:38.324 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:14:38.326 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:14:38.326 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:14:38.328 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:14:38.353 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:14:38.353 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:14:38.353 INFO:teuthology.packaging:ref: None 2024-08-17T02:14:38.353 INFO:teuthology.packaging:tag: None 2024-08-17T02:14:38.353 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:38.353 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:14:38.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:38.495 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:14:38.497 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:14:38.504 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:14:38.504 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:14:38.514 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:14:38.530 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:14:38.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:14:38.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:50.392305', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:14:38.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:50.393680', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:14:38.584 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:14:38.589 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:14:38.590 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:14:38.590 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:14:38.650 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68cc557ac0>, signals=[15]) 2024-08-17T02:14:38.650 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:14:38.656 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:14:38.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:14:38.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.765 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:14:38.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.854 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:14:38.860 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-08-17T02:14:38.867 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-08-17T02:14:38.868 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-08-17T02:14:38.917 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2024-08-17T02:14:38.917 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:14:38.917 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2024-08-17T02:14:38.917 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2024-08-17T02:14:38.917 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2024-08-17T02:14:38.918 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:14:38.919 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-08-17T02:14:38.940 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-08-17T02:14:38.946 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-08-17T02:14:38.946 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Ubuntu" 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:ID=ubuntu 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE=debian 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="20.04" 2024-08-17T02:14:38.996 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:14:38.997 INFO:teuthology.orchestra.run.smithi189.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:14:38.997 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:14:38.997 INFO:teuthology.orchestra.run.smithi189.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:14:38.997 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_CODENAME=focal 2024-08-17T02:14:38.997 INFO:teuthology.orchestra.run.smithi189.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:14:38.997 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-08-17T02:14:39.015 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:14:39.024 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:14:39.029 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:14:39.030 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:39.032 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:39.037 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:14:39.043 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:14:39.043 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:39.045 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:39.071 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:14:39.125 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:14:39.142 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:14:39.142 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:14:39.142 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:39.143 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:39.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:39.148 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-08-17T02:14:39.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:39.149 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-08-17T02:14:39.155 INFO:teuthology.orchestra.run.smithi155.stdout:5.4.0-124-generic 2024-08-17T02:14:39.155 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.4.0-124-generic 2024-08-17T02:14:39.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-08-17T02:14:39.157 INFO:teuthology.orchestra.run.smithi189.stdout:5.4.0-124-generic 2024-08-17T02:14:39.157 INFO:teuthology.task.kernel:Running kernel on smithi189: 5.4.0-124-generic 2024-08-17T02:14:39.157 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-08-17T02:14:39.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-08-17T02:14:39.309 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-08-17T02:14:39.401 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:14:39.520 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:39.602 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:14:39.613 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:39.613 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:14:39.673 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:14:39.706 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:14:39.811 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:14:39.853 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:14:39.856 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:14:39.860 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:14:39.860 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:14:39.880 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:14:39.883 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:14:39.883 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:14:39.890 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:14:39.895 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:14:39.896 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:14:39.896 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:14:39.897 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:14:39.897 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:14:39.905 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:14:40.094 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:14:40.105 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:14:40.242 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:14:40.336 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:14:40.503 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:14:40.516 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:14:40.516 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:14:40.517 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:14:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:14:40.609 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:14:40.623 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:14:40.626 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:14:40.627 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:14:40.631 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:14:40.631 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:14:40.632 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:14:40.648 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:14:40.677 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:14:40.683 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:14:40.684 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:14:40.684 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:14:40.685 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:14:40.706 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:14:40.719 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:14:40.722 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:14:40.727 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:14:40.727 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:14:40.731 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:14:40.731 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:14:40.732 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:14:40.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:14:40.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:14:40.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:14:40.753 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:14:40.777 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:14:40.788 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:14:40.794 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:14:40.794 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:14:40.794 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:14:40.794 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:14:40.820 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:14:40.828 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:14:40.828 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:14:40.831 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:14:40.832 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:14:40.833 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:14:40.867 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:14:40.883 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:14:40.895 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:14:40.900 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:14:40.900 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:14:40.900 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:14:40.900 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:14:40.967 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:14:40.968 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:14:40.968 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:14:40.969 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:14:41.048 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:14:41.049 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:14:41.049 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:14:44.265 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 21.4 MB in 3s (7,446 kB/s) 2024-08-17T02:14:45.076 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 21.4 MB in 4s (6,085 kB/s) 2024-08-17T02:14:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:14:45.869 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:45.940 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:14:46.133 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-08-17T02:14:46.133 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-08-17T02:14:46.332 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-08-17T02:14:46.332 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:14:46.332 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:14:46.332 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:14:46.333 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-08-17T02:14:46.333 INFO:teuthology.orchestra.run.smithi155.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:14:46.333 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-08-17T02:14:46.334 INFO:teuthology.orchestra.run.smithi155.stdout: thermald 2024-08-17T02:14:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-08-17T02:14:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:14:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:14:46.394 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:14:46.396 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-08-17T02:14:46.396 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:14:46.470 INFO:teuthology.orchestra.run.smithi155.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:46.470 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:14:46.470 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:14:46.470 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:14:46.613 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:14:46.637 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:46.714 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:14:46.800 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:14:46.895 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:14:46.929 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-08-17T02:14:46.930 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-08-17T02:14:47.127 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-08-17T02:14:47.127 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:14:47.127 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:14:47.127 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:14:47.129 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-08-17T02:14:47.129 INFO:teuthology.orchestra.run.smithi189.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:14:47.129 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-08-17T02:14:47.129 INFO:teuthology.orchestra.run.smithi189.stdout: thermald 2024-08-17T02:14:47.183 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-08-17T02:14:47.183 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:14:47.183 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:14:47.183 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:14:47.184 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages will be upgraded: 2024-08-17T02:14:47.184 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:14:47.348 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:14:47.348 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:14:47.349 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:14:47.366 INFO:teuthology.orchestra.run.smithi189.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:47.367 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:14:47.367 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:14:47.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:14:47.442 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:14:47.452 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:14:48.135 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 77.2 MB in 1s (73.6 MB/s) 2024-08-17T02:14:48.338 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:14:48.521 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:14:48.792 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:14:50.005 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:14:50.010 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:50.102 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:50.127 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:14:50.127 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:14:50.127 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:14:50.411 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:14:50.427 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:14:51.113 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 77.2 MB in 3s (23.9 MB/s) 2024-08-17T02:14:51.290 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:14:52.027 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:14:52.041 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:52.150 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:52.935 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:14:52.940 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:53.029 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:53.288 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:14:53.304 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:53.346 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:54.912 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:14:54.928 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:55.045 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:56.157 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:14:56.171 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:56.215 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:58.149 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:58.292 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:58.625 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:58.769 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:59.090 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:14:59.105 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:14:59.148 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:15:01.044 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:15:01.172 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:15:01.538 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:15:01.658 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:15:02.003 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:15:02.016 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:15:02.061 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:15:05.328 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:15:05.352 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:15:05.394 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:07.474 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:15:07.497 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:15:07.541 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:08.032 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:15:08.150 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:15:08.470 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:15:08.591 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:09.835 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:10.355 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:15:10.483 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:15:10.824 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:15:10.980 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:10.980 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:10.987 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:11.111 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:11.212 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:12.189 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:12.405 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:15:12.565 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:15:12.691 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:15:13.333 INFO:teuthology.orchestra.run.smithi189.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:13.333 INFO:teuthology.orchestra.run.smithi189.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:13.466 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:13.593 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:13.593 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:14.048 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:15:14.049 INFO:teuthology.orchestra.run.smithi155.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:15.664 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:15:16.537 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:15:16.663 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:15:16.790 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:15:16.886 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:15:16.886 INFO:teuthology.orchestra.run.smithi189.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:36.853 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:15:36.853 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:15:36.876 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:15:36.897 INFO:teuthology.orchestra.run.smithi155.stdout:Generating grub configuration file ... 2024-08-17T02:15:37.237 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:37.255 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:37.659 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:15:37.671 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:15:38.596 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:15:38.597 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:15:38.605 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:15:38.625 INFO:teuthology.orchestra.run.smithi189.stdout:Generating grub configuration file ... 2024-08-17T02:15:38.982 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:39.004 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:39.379 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:15:39.391 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:15:39.807 INFO:teuthology.orchestra.run.smithi155.stdout:done 2024-08-17T02:15:40.211 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-08-17T02:15:40.263 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 20 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.4.0.192.190 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-08-17T02:15:40.264 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:15:40.265 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-08-17T02:15:40.265 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:15:40.265 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:15:40.265 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:15:40.265 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:15:40.265 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:15:40.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-08-17T02:15:40.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-08-17T02:15:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:15:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:15:40.684 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:15:40.766 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:15:41.222 INFO:teuthology.orchestra.run.smithi189.stdout:done 2024-08-17T02:15:41.644 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-08-17T02:15:41.694 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 20 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.4.0.192.190 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:15:41.695 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-08-17T02:15:41.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:15:41.696 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:15:41.696 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:15:41.696 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:15:41.696 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:15:41.696 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-08-17T02:15:41.800 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-08-17T02:15:42.061 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:15:42.061 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:15:42.131 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:15:42.221 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:15:42.457 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:15:42.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:15:42.559 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-08-17T02:15:43.005 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:15:43.005 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:15:43.007 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-08-17T02:15:43.030 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-08-17T02:15:43.030 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-08-17T02:15:43.030 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 20 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.4.0.192.190 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:15:43.031 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-08-17T02:15:43.032 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-08-17T02:15:43.077 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.l4lrlMOpir 2024-08-17T02:15:43.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l4lrlMOpir 2024-08-17T02:15:43.109 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.l4lrlMOpir 2024-08-17T02:15:43.151 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.l4lrlMOpir is 9KB 2024-08-17T02:15:43.169 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.l4lrlMOpir 2024-08-17T02:15:43.178 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:15:43.234 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:15:43.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:15:43.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:15:43.267 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:15:43.267 DEBUG:teuthology.orchestra.run.smithi155:> sudo update-grub 2024-08-17T02:15:43.930 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:15:43.957 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:15:44.032 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:15:44.258 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-08-17T02:15:44.258 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-08-17T02:15:44.500 INFO:teuthology.orchestra.run.smithi189.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:15:44.500 INFO:teuthology.orchestra.run.smithi189.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:15:44.501 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 20 2024-08-17T02:15:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.4.0.192.190 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:15:44.521 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-08-17T02:15:44.522 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-08-17T02:15:44.527 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.NlPc14cG5A 2024-08-17T02:15:44.528 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NlPc14cG5A 2024-08-17T02:15:44.540 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.NlPc14cG5A 2024-08-17T02:15:44.553 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:15:44.559 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:15:44.567 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-08-17T02:15:44.581 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.NlPc14cG5A is 9KB 2024-08-17T02:15:44.601 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.NlPc14cG5A 2024-08-17T02:15:44.609 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:15:44.663 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:15:44.663 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:15:44.663 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:15:44.696 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:15:44.696 DEBUG:teuthology.orchestra.run.smithi189:> sudo update-grub 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:45.183 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:15:45.199 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:15:46.051 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:15:46.060 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:15:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-08-17T02:15:46.311 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-08-17T02:15:46.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-08-17T02:15:46.327 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:15:46.338 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:15:46.739 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:15:46.751 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:15:47.500 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-08-17T02:15:47.502 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-08-17T02:16:16.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:16:16.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:16:16.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:17.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:16:17.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:16:17.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:34.783 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-08-17T02:16:36.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-08-17T02:16:43.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:16:43.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:45.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:16:45.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:46.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-08-17T02:16:48.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-08-17T02:16:58.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:16:58.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:00.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:17:00.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:17.283 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-08-17T02:17:32.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:17:32.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:32.701 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-08-17T02:17:33.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:17:33.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:17:33.933 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-08-17T02:17:33.938 INFO:teuthology.orchestra.run.smithi155.stdout:5.4.0-192-generic 2024-08-17T02:17:33.939 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:17:33.939 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:17:33.939 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:17:34.939 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:17:34.940 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:17:35.020 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-08-17T02:17:35.043 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:00.131 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:18:15.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:18:15.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:15.393 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-08-17T02:18:16.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:18:16.016 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:18:16.017 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-08-17T02:18:16.023 INFO:teuthology.orchestra.run.smithi189.stdout:5.4.0-192-generic 2024-08-17T02:18:16.023 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:18:16.023 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:18:16.023 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:18:17.024 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:18:17.024 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:18:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-08-17T02:18:17.156 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:17.156 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:18:17.166 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:18:17.166 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:17.168 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:17.175 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:18:17.186 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:18:17.195 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:18:17.196 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:17.198 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:17.234 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:18:17.241 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:18:17.241 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:17.263 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:17.281 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:17.292 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:17.299 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:17.300 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:18:17.307 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:18:17.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:17.309 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:17.354 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:18:17.364 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:18:17.364 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:17.366 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:17.372 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:17.378 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:17.386 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:18:17.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:17.459 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:17.467 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:17.516 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:18:17.516 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:17.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-08-17T02:18:17.539 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-08-17T02:18:17.589 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:18:17.597 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:18:17.598 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:18:17.613 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:18:17.623 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2024-08-17T02:18:17.623 DEBUG:teuthology.task.selinux:Excluding smithi189: OS 'ubuntu' does not support SELinux 2024-08-17T02:18:17.623 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:18:17.623 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:18:17.623 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:18:17.623 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:18:17.633 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:18:17.646 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:18:17.647 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi155.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:23:53.042 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-08-17T02:23:53.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:23:53.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:53.138 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-08-17T02:23:53.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-08-17T02:23:53.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:23:53.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:53.354 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-08-17T02:23:53.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-08-17T02:23:53.480 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:23:53.493 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:23:53.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:53.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:53.496 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:53.497 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:53.527 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:23:53.528 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Command line: ntpd -gq 2024-08-17T02:23:53.529 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: proto: precision = 0.117 usec (-23) 2024-08-17T02:23:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:23:53.529 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:23:53.530 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen normally on 4 lo [::1]:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2024-08-17T02:23:53.531 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:23:53 ntpd[13636]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:23:53.556 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:23:53.556 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Command line: ntpd -gq 2024-08-17T02:23:53.557 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: proto: precision = 0.078 usec (-24) 2024-08-17T02:23:53.557 INFO:teuthology.orchestra.run.smithi189.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:23:53.558 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:23:53.558 INFO:teuthology.orchestra.run.smithi189.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen normally on 3 enp3s0f1 172.21.15.189:123 2024-08-17T02:23:53.559 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen normally on 4 lo [::1]:123 2024-08-17T02:23:53.560 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df1%5]:123 2024-08-17T02:23:53.560 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:23:53 ntpd[13615]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:23:54.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:54.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:54.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:54.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:54.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:54 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:54.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:54.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:54.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:54.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:54.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:54.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:54.559 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:54.559 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:54 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:55.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:55.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:55.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:55.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:55.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:55.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:55 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:55.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:55.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:55.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:55.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:55.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:55.559 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:55 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:56 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:56.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:56.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:56.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:56.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:56.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:56.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:56 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:57.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:57 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:57.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:57 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:58.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:58.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:58 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:58.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:58.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:58 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:23:59 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:23:59.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:59.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:59.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:23:59.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:23:59.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:23:59.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:23:59 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:24:00.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.529 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stdout:17 Aug 02:24:00 ntpd[13636]: ntpd: time slew +0.000451 s 2024-08-17T02:24:00.530 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew +0.000451s 2024-08-17T02:24:00.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:24:00.531 INFO:teuthology.orchestra.run.smithi155.stderr:17 Aug 02:24:00 ntpd[13636]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:24:00.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.557 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stdout:17 Aug 02:24:00 ntpd[13615]: ntpd: time slew +0.000336 s 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stdout:ntpd: time slew +0.000336s 2024-08-17T02:24:00.558 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:24:00.559 INFO:teuthology.orchestra.run.smithi189.stderr:17 Aug 02:24:00 ntpd[13615]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:24:00.591 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:24:00.592 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-08-17T02:24:00.592 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.592 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.592 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.592 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.627 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:24:00.627 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:24:00.635 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:24:00.635 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:24:00.635 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:24:00.636 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:24:00.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:24:00.641 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:24:00.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2024-08-17T02:24:00.642 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-key list | grep Ceph 2024-08-17T02:24:00.747 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:24:00.747 INFO:teuthology.orchestra.run.smithi189.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:24:00.806 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:24:00.806 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:24:00.807 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:24:00.807 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:24:00.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:00.813 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:24:00.813 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:24:00.813 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:24:00.813 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:24:00.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:00.956 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:24:00.956 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:00.959 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:24:00.959 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:01.068 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:24:01.068 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:24:01.080 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:24:01.080 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:24:01.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-08-17T02:24:01.096 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-08-17T02:24:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:24:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:24:01.266 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:24:01.277 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:24:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:24:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:24:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:24:01.345 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:24:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:24:01.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:24:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:24:01.390 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:24:01.418 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:24:01.418 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:24:01.418 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:24:01.451 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:24:01.487 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:24:01.570 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:24:01.894 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 28.5 kB in 1s (43.7 kB/s) 2024-08-17T02:24:02.088 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 28.5 kB in 1s (36.7 kB/s) 2024-08-17T02:24:03.040 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:24:03.065 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:03.138 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:24:03.233 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:24:03.259 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:03.333 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:24:03.350 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-08-17T02:24:03.351 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-08-17T02:24:03.538 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:24:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:24:03.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:24:03.542 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-08-17T02:24:03.543 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2024-08-17T02:24:03.548 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-08-17T02:24:03.549 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-08-17T02:24:03.667 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:24:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:24:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:24:03.671 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-08-17T02:24:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 librbd1 2024-08-17T02:24:03.735 INFO:teuthology.orchestra.run.smithi155.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:24:03.735 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 201 MB of archives. 2024-08-17T02:24:03.735 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:24:03.735 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:24:03.741 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:24:03.743 INFO:teuthology.orchestra.run.smithi189.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:24:03.744 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:24:03.745 INFO:teuthology.orchestra.run.smithi189.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:24:03.746 INFO:teuthology.orchestra.run.smithi189.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:24:03.747 INFO:teuthology.orchestra.run.smithi189.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:24:03.747 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-08-17T02:24:03.747 INFO:teuthology.orchestra.run.smithi189.stdout: btrfs-tools 2024-08-17T02:24:03.753 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:24:03.761 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:24:03.787 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:24:03.815 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:24:03.817 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:24:03.820 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:24:03.826 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:24:03.830 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:24:03.847 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:24:03.848 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:24:03.853 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:24:03.868 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:24:03.869 INFO:teuthology.orchestra.run.smithi189.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:24:03.870 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:24:03.871 INFO:teuthology.orchestra.run.smithi189.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:24:03.872 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages will be upgraded: 2024-08-17T02:24:03.872 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 librbd1 2024-08-17T02:24:03.880 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:24:03.882 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:24:03.887 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:24:03.889 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:24:03.889 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:24:03.895 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:24:03.895 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:24:03.896 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:24:03.896 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:24:03.901 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:24:03.902 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:24:03.919 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:24:03.919 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:24:03.920 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:24:03.921 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:24:03.921 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:24:03.922 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:24:03.923 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:24:03.924 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:24:03.935 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:24:03.936 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:24:03.938 INFO:teuthology.orchestra.run.smithi189.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:24:03.938 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 201 MB of archives. 2024-08-17T02:24:03.938 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:24:03.938 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:24:03.952 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:24:03.957 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:24:03.959 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:24:03.959 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:24:03.960 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:24:03.961 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:24:03.962 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:24:03.964 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:24:03.964 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:24:03.965 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:24:03.969 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:24:03.970 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:24:03.986 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:24:03.987 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:24:03.988 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:24:03.989 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:24:03.990 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:24:03.991 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:24:04.020 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:24:04.022 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:24:04.030 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:24:04.031 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:24:04.034 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:24:04.041 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:24:04.052 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:24:04.053 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:24:04.053 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:24:04.058 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:24:04.061 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:24:04.061 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:24:04.064 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:24:04.065 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:24:04.069 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:24:04.072 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:24:04.086 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:24:04.088 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:24:04.093 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:24:04.095 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:24:04.096 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:24:04.098 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:24:04.098 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:24:04.098 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:24:04.099 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:24:04.108 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:24:04.108 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:24:04.126 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:24:04.126 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:24:04.126 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:24:04.127 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:24:04.128 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:24:04.128 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:24:04.130 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:24:04.130 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:24:04.135 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:24:04.137 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:24:04.142 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:24:04.143 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:24:04.156 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:24:04.156 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:24:04.156 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:24:04.157 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:24:04.157 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:24:04.157 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:24:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:24:04.158 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:24:04.159 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:24:04.166 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:24:04.166 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:24:04.167 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:24:04.167 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:24:04.168 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:24:04.168 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:24:04.169 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:24:04.170 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:24:04.173 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:24:04.175 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:24:04.176 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:24:04.177 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:24:04.177 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:24:04.177 INFO:teuthology.orchestra.run.smithi189.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:24:04.179 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:24:04.181 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:24:04.183 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:24:04.184 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:24:04.187 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:24:04.189 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:24:04.189 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:24:04.193 INFO:teuthology.orchestra.run.smithi189.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:24:04.194 INFO:teuthology.orchestra.run.smithi189.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:24:04.194 INFO:teuthology.orchestra.run.smithi189.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:24:04.195 INFO:teuthology.orchestra.run.smithi189.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:24:04.203 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:24:04.206 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:24:04.246 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:24:04.246 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:24:04.247 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:24:04.247 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:24:04.247 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:24:04.248 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:24:04.260 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:24:04.260 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:24:04.260 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:24:04.264 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:24:04.281 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:24:04.282 INFO:teuthology.orchestra.run.smithi189.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:24:04.282 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:24:04.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:24:04.285 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:24:04.297 INFO:teuthology.orchestra.run.smithi189.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:24:04.299 INFO:teuthology.orchestra.run.smithi189.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:24:04.310 INFO:teuthology.orchestra.run.smithi189.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:24:04.310 INFO:teuthology.orchestra.run.smithi189.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:24:04.371 INFO:teuthology.orchestra.run.smithi189.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:24:04.372 INFO:teuthology.orchestra.run.smithi189.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:24:04.373 INFO:teuthology.orchestra.run.smithi189.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:24:04.373 INFO:teuthology.orchestra.run.smithi189.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:24:04.374 INFO:teuthology.orchestra.run.smithi189.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:24:04.376 INFO:teuthology.orchestra.run.smithi189.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:24:04.376 INFO:teuthology.orchestra.run.smithi189.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:24:04.377 INFO:teuthology.orchestra.run.smithi189.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:24:04.381 INFO:teuthology.orchestra.run.smithi189.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:24:04.389 INFO:teuthology.orchestra.run.smithi189.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:24:04.401 INFO:teuthology.orchestra.run.smithi189.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:24:04.402 INFO:teuthology.orchestra.run.smithi189.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:24:04.405 INFO:teuthology.orchestra.run.smithi189.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:24:04.409 INFO:teuthology.orchestra.run.smithi189.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:24:04.409 INFO:teuthology.orchestra.run.smithi189.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:24:04.427 INFO:teuthology.orchestra.run.smithi189.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:24:04.429 INFO:teuthology.orchestra.run.smithi189.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:24:04.464 INFO:teuthology.orchestra.run.smithi189.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:24:04.464 INFO:teuthology.orchestra.run.smithi189.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:24:04.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:24:04.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:24:04.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:24:04.466 INFO:teuthology.orchestra.run.smithi189.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:24:04.477 INFO:teuthology.orchestra.run.smithi189.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:24:04.478 INFO:teuthology.orchestra.run.smithi189.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:24:04.478 INFO:teuthology.orchestra.run.smithi189.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:24:04.481 INFO:teuthology.orchestra.run.smithi189.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:24:04.498 INFO:teuthology.orchestra.run.smithi189.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:24:04.499 INFO:teuthology.orchestra.run.smithi189.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:24:04.501 INFO:teuthology.orchestra.run.smithi189.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:24:04.501 INFO:teuthology.orchestra.run.smithi189.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:24:04.718 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:24:04.760 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:24:04.761 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:24:04.763 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:24:04.787 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:24:04.866 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:24:05.338 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:24:05.339 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:24:05.351 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:24:05.368 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:24:05.369 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:24:05.370 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:24:05.404 INFO:teuthology.orchestra.run.smithi189.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:24:05.466 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:24:05.604 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:24:05.604 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:24:06.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:24:06.179 INFO:teuthology.orchestra.run.smithi189.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:24:06.236 INFO:teuthology.orchestra.run.smithi189.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:24:06.237 INFO:teuthology.orchestra.run.smithi189.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:24:06.242 INFO:teuthology.orchestra.run.smithi189.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:24:06.243 INFO:teuthology.orchestra.run.smithi189.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:24:06.299 INFO:teuthology.orchestra.run.smithi189.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:24:06.729 INFO:teuthology.orchestra.run.smithi189.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:24:06.730 INFO:teuthology.orchestra.run.smithi189.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:24:06.739 INFO:teuthology.orchestra.run.smithi189.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:24:06.873 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:24:06.877 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:24:06.882 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:24:06.883 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:24:06.884 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:24:06.884 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:24:07.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:24:07.528 INFO:teuthology.orchestra.run.smithi189.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:24:07.573 INFO:teuthology.orchestra.run.smithi189.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:24:07.580 INFO:teuthology.orchestra.run.smithi189.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:24:07.580 INFO:teuthology.orchestra.run.smithi189.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:24:07.598 INFO:teuthology.orchestra.run.smithi189.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:24:07.675 INFO:teuthology.orchestra.run.smithi189.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:24:07.921 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 201 MB in 4s (55.8 MB/s) 2024-08-17T02:24:08.044 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:24:08.102 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:24:08.107 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:24:08.130 INFO:teuthology.orchestra.run.smithi189.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:24:08.130 INFO:teuthology.orchestra.run.smithi189.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:24:08.142 INFO:teuthology.orchestra.run.smithi189.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:24:08.159 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:24:08.159 INFO:teuthology.orchestra.run.smithi189.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:24:08.160 INFO:teuthology.orchestra.run.smithi189.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:24:08.161 INFO:teuthology.orchestra.run.smithi189.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:24:08.252 INFO:teuthology.orchestra.run.smithi189.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:24:08.381 INFO:teuthology.orchestra.run.smithi189.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:24:08.382 INFO:teuthology.orchestra.run.smithi189.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:24:08.495 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:24:08.512 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:24:08.553 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:24:08.840 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:24:08.857 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:24:08.890 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:24:09.251 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:24:09.267 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:24:09.351 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:24:09.489 INFO:teuthology.orchestra.run.smithi189.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:24:09.494 INFO:teuthology.orchestra.run.smithi189.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:24:09.499 INFO:teuthology.orchestra.run.smithi189.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:24:09.499 INFO:teuthology.orchestra.run.smithi189.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:24:09.500 INFO:teuthology.orchestra.run.smithi189.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:24:09.546 INFO:teuthology.orchestra.run.smithi189.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:24:09.716 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:09.822 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:24:09.853 INFO:teuthology.orchestra.run.smithi189.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:24:10.503 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 201 MB in 6s (33.7 MB/s) 2024-08-17T02:24:10.542 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:10.650 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:24:10.668 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:24:10.706 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:24:10.711 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:24:11.043 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:24:11.093 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:24:11.379 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:24:11.395 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:24:11.415 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:24:11.434 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:11.437 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:24:11.473 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.807 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:24:11.824 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:24:11.830 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:24:11.850 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:11.892 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.907 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:24:12.237 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:12.245 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:24:12.261 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:12.320 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.344 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:24:12.581 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:12.632 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.009 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:24:13.025 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:13.031 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:13.067 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.157 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:24:13.421 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:24:13.437 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:24:13.479 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:24:13.765 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:24:13.782 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:13.819 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:24:13.823 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.837 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:13.877 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.180 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:24:14.200 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:14.210 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:24:14.238 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.268 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:24:14.608 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:24:14.625 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:14.637 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:24:14.656 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:24:14.666 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.695 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:24:14.918 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:24:14.934 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:14.976 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:15.058 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:24:15.076 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:24:15.116 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:24:15.271 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:24:15.288 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:15.329 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:15.511 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:24:15.526 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:24:15.560 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:24:15.624 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:24:15.640 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:24:15.682 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:24:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:24:15.935 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:24:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:24:15.951 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:24:15.993 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:16.379 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:24:16.395 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:24:16.437 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:24:16.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:24:16.493 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:16.544 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:16.784 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:24:16.802 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:24:16.842 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:24:17.054 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:24:17.072 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:17.112 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:17.195 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:24:17.213 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:24:17.253 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:24:17.499 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:24:17.516 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:17.557 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:17.648 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:24:17.665 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:24:17.706 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:24:17.977 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:24:17.993 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:24:18.035 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:18.051 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:24:18.067 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:24:18.109 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:24:18.406 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:24:18.424 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:18.464 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.563 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:24:18.578 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:18.631 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:19.115 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:24:19.133 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:19.173 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:19.258 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:24:19.276 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:19.316 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.535 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:24:19.552 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:24:19.593 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:19.694 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:24:19.714 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:24:19.752 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:24:19.929 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:24:19.946 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:24:19.987 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:20.072 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:24:20.091 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:20.130 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:20.324 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:24:20.341 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:20.382 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:20.617 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:24:20.633 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:20.675 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:21.151 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:24:21.167 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:21.200 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:21.770 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:24:21.789 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:24:21.828 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:24:22.139 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:24:22.157 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:22.197 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:22.684 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:24:22.700 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:22.742 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:23.257 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:24:23.275 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:23.325 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:24.161 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:24:24.179 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:24:24.211 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:24:24.590 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:24:24.609 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:24:24.640 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:24.985 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:24:25.001 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:24:25.034 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:24:25.306 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:24:25.323 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:25.329 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:25.374 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:25.387 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:25.776 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:24:25.793 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:24:25.834 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:24:26.154 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:24:26.218 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:24:26.228 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:24:26.235 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:24:26.276 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:24:26.566 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:24:26.582 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:24:26.648 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:24:26.688 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:24:26.704 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:24:26.746 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:26.944 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:24:26.963 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:24:27.002 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:24:27.057 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:24:27.076 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:24:27.115 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:24:27.339 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:24:27.355 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:24:27.368 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:24:27.384 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:27.405 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:24:27.426 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:27.725 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:24:27.741 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:24:27.783 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:24:27.814 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:24:27.830 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:24:27.872 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:24:28.111 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:24:28.129 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:24:28.170 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:24:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:24:28.201 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:24:28.259 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:24:28.515 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:24:28.531 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:24:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:24:28.620 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:24:28.636 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:24:28.678 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:24:28.901 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:24:28.920 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:24:28.959 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:24:28.973 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:24:28.990 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:24:29.031 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:24:29.246 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:24:29.264 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:24:29.304 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:24:29.376 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:24:29.396 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:24:29.434 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:24:29.624 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:24:29.643 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:24:29.682 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:24:29.703 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:24:29.721 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:24:29.761 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:24:30.018 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:24:30.031 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:24:30.068 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:30.072 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:24:30.090 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:24:30.156 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:24:30.446 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:24:30.464 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:24:30.484 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:24:30.504 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:24:30.507 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:24:30.542 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:24:30.845 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:24:30.862 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:24:30.866 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:24:30.882 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:24:30.903 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:24:30.924 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:24:31.231 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:24:31.246 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:24:31.269 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:24:31.285 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:24:31.288 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:24:31.327 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:24:31.592 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:24:31.607 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:24:31.650 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:24:31.664 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:24:31.683 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:24:31.723 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:24:32.003 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:24:32.019 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:24:32.034 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:24:32.055 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:24:32.061 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:32.084 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:32.379 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:24:32.395 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:24:32.405 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:24:32.422 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:24:32.428 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:24:32.467 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:24:32.757 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:24:32.773 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:24:32.815 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:32.825 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:24:32.842 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:24:32.883 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:24:33.186 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:24:33.195 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:24:33.202 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:24:33.212 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:24:33.244 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:24:33.253 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:24:33.556 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:24:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:24:33.622 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:24:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:33.667 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:33.929 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:24:33.946 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:24:33.978 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:34.054 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:24:34.070 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:34.114 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:34.282 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:24:34.298 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:24:34.340 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:24:34.611 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:24:34.627 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:34.669 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:34.677 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:24:34.694 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:35.081 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:24:35.098 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:24:35.139 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:24:35.449 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:35.476 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.491 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:35.534 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.870 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:24:35.886 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:35.928 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.473 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:24:36.490 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:36.531 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:38.078 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:24:38.094 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:38.136 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:38.518 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2024-08-17T02:24:38.535 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:38.576 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:38.920 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:24:38.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:38.978 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:39.374 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:24:39.389 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:39.423 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:39.994 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:24:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:40.052 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.291 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph. 2024-08-17T02:24:40.307 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:40.340 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.397 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:24:40.413 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:24:40.455 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:24:40.602 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:24:40.619 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:40.673 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.783 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:24:40.802 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:40.841 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:41.070 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:24:41.086 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:41.128 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:41.187 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:24:41.204 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:24:41.244 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:24:41.464 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:24:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:24:41.556 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:24:41.706 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:24:41.723 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:41.764 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:41.833 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:24:41.851 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:24:41.892 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:42.083 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:24:42.099 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:24:42.133 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:24:42.219 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:24:42.239 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:24:42.278 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:24:42.470 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:24:42.486 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:42.631 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:24:42.648 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:42.689 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:42.915 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:24:42.931 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:24:42.973 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:24:43.209 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:24:43.225 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:24:43.308 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:24:43.578 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:24:43.594 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:24:43.636 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:43.955 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:24:43.971 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:24:44.011 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:24:44.013 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:24:44.031 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:24:44.069 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:24:44.341 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:24:44.358 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:44.399 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:44.406 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:24:44.422 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:24:44.464 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:24:44.825 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:24:44.867 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:24:45.714 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:24:45.745 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:24:46.065 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:24:46.084 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:24:46.123 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:24:46.203 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:24:46.220 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:24:46.261 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:46.434 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:24:46.450 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:24:46.492 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:24:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:24:46.797 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:24:46.839 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:24:47.227 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:24:47.247 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:24:47.284 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:24:47.842 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:24:47.892 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:48.027 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:24:48.043 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:48.085 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:48.438 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:24:48.455 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:24:48.496 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:24:48.883 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:24:48.899 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:24:48.941 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:49.230 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:24:49.246 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:24:49.288 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:24:49.616 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:24:49.624 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:24:49.634 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:49.899 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:49.899 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:24:49.899 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:24:50.053 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:24:50.072 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:24:50.111 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:50.422 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:24:50.438 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:24:50.513 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:24:50.793 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:24:50.813 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:24:50.825 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:24:50.841 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:24:50.851 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:24:50.875 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:51.179 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:24:51.195 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:24:51.197 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:24:51.215 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:24:51.237 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:24:51.253 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:24:51.549 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:24:51.569 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:24:51.581 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:24:51.597 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:24:51.607 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:51.639 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:51.909 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:24:51.929 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:24:51.967 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:24:52.071 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:24:52.091 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:24:52.129 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:52.304 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:24:52.320 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:24:52.362 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:52.449 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:24:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:24:52.690 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:24:52.707 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:24:52.748 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:24:52.896 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:24:52.913 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:24:52.953 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:53.404 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:24:53.424 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:24:53.467 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:53.510 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:24:53.530 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:53.568 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:53.907 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:24:53.923 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:24:53.956 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:24:54.267 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:24:54.288 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:24:54.305 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:24:54.311 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:24:54.346 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:24:54.649 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:24:54.665 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:24:54.707 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:54.745 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:24:54.761 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:54.803 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:55.097 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2024-08-17T02:24:55.116 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:55.155 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:55.271 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:24:55.290 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:24:55.328 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:55.408 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2024-08-17T02:24:55.425 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:24:55.483 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:24:55.682 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:24:55.740 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:24:55.812 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:24:55.828 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:24:55.889 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:24:56.093 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:24:56.113 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:56.151 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:56.208 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:24:56.224 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:56.267 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:56.462 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package jq. 2024-08-17T02:24:56.479 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:56.520 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package socat. 2024-08-17T02:24:56.792 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:24:56.834 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:24:57.146 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:24:57.163 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:24:57.204 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:24:57.550 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:24:57.567 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:57.599 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:00.855 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:25:00.873 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:00.904 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:01.397 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:01.743 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:25:01.760 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:25:01.801 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:25:02.088 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:25:02.104 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:02.146 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:02.187 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:25:02.206 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:02.245 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:02.426 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:25:02.442 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:02.484 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:02.659 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:25:02.675 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:02.717 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:25:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:25:02.828 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:03.070 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:25:03.087 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:25:03.128 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:25:03.349 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:25:03.350 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:25:03.367 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:03.368 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:03.407 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:03.433 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:03.686 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:25:03.705 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:25:03.753 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:25:03.843 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:25:03.903 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:25:04.007 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:25:04.023 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:25:04.065 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:25:04.276 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:25:04.315 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:04.594 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:25:04.611 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:04.651 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:05.046 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:25:05.063 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:25:05.156 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:25:05.484 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:25:05.503 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:25:05.542 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:06.031 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:25:06.053 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:25:06.097 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:25:06.471 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:25:06.508 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:25:06.834 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:25:06.853 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:25:06.902 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:25:07.239 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:25:07.241 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:25:07.256 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:25:07.260 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:25:07.299 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:25:07.313 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:25:07.608 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:25:07.626 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:25:07.635 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:25:07.652 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:25:07.666 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:25:07.702 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:25:08.013 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:25:08.019 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:25:08.033 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:25:08.037 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:25:08.071 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:25:08.077 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:25:08.415 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:25:08.434 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:25:08.473 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:25:08.547 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:25:08.565 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:25:08.629 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:25:08.811 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:25:08.851 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:25:08.959 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:25:08.975 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:25:09.016 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:25:09.196 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:25:09.214 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:25:09.253 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:25:09.387 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:25:09.403 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:25:09.444 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:25:09.740 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:25:09.761 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:25:09.797 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:25:09.814 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:25:09.855 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:25:10.118 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:25:10.138 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:25:10.176 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:25:10.200 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:25:10.218 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:25:10.258 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:25:10.512 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:25:10.533 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:25:10.570 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:25:10.595 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:25:10.611 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:25:10.653 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:25:10.907 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:25:10.923 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:25:10.965 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:25:11.006 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:25:11.023 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:25:11.064 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:25:11.318 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:25:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:25:11.370 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:25:11.375 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:25:11.386 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:25:11.428 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:25:11.662 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:25:11.680 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:25:11.720 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:25:12.139 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:25:12.174 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:25:12.190 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:12.248 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:12.409 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:25:12.427 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:25:12.458 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:25:13.146 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:25:13.163 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:13.195 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:14.044 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:25:14.060 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:14.101 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:14.409 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:25:14.731 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:25:14.866 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:25:14.968 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:25:14.988 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:25:15.018 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:25:15.026 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:15.221 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:15.339 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:25:15.648 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:25:15.757 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2024-08-17T02:25:15.774 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:25:15.900 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:25:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:25:16.093 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:16.412 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user cephadm....done 2024-08-17T02:25:16.714 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:16.826 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:16.841 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:25:16.952 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:25:16.967 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:25:17.294 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:25:17.295 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:25:17.621 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:25:17.704 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:25:17.756 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:25:17.873 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:25:17.997 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:25:18.183 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:25:18.594 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:25:18.658 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:25:18.887 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:25:18.959 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:25:19.197 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:25:19.251 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:25:19.544 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:25:19.670 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:25:19.749 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:25:19.954 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:25:20.042 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:20.239 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:25:20.351 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:25:20.477 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:25:20.540 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:25:20.674 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:25:20.761 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:25:21.071 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:25:21.092 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:25:21.363 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:25:21.410 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:25:21.498 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:25:21.694 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:25:21.866 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:25:22.020 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:25:22.150 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:25:22.329 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:25:22.426 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:25:22.769 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:25:22.964 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:25:23.053 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:25:23.266 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:25:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:25:23.418 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:25:23.551 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:25:23.688 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:25:23.869 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:25:24.018 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:25:24.262 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:25:24.589 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:25:24.657 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:25:24.783 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:25:25.059 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:25:25.165 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:25:25.542 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:25:25.693 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:25.753 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:25:26.002 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:26.121 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:25:26.161 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:25:26.521 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:25:26.592 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:26.664 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:25:26.781 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:25:26.902 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:27.058 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:25:27.061 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:25:27.367 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:27.405 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:25:27.522 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:25:27.526 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:25:27.623 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:25:27.652 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:25:27.917 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:25:27.987 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:25:28.243 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:28.255 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:25:28.369 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:25:28.581 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:25:28.715 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:25:28.821 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:25:29.033 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:25:29.089 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:25:29.317 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:25:29.365 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:25:29.483 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:25:29.610 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:25:29.801 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:25:30.102 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:25:30.246 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:25:30.355 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:25:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:25:30.682 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:25:30.842 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:25:31.058 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:25:31.072 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:25:31.173 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:25:31.186 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:25:31.310 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:25:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:25:31.636 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:25:31.826 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:25:31.945 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:31.952 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:25:32.071 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:25:32.078 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:25:32.430 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:25:32.714 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:32.815 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:25:33.493 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:25:33.770 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:25:34.161 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:25:34.279 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:34.405 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:25:34.456 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:25:34.506 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:25:34.749 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:34.867 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:25:34.875 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:25:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:25:35.218 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:35.344 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:25:35.460 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:25:35.586 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:25:35.671 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:35.788 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:25:35.954 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:36.080 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:25:36.114 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:25:36.391 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:36.542 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:25:36.876 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:25:37.161 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:37.312 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:25:37.438 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:25:37.539 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:25:37.923 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:37.975 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:25:38.041 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:25:38.101 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:25:38.167 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:25:38.318 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:25:38.444 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:25:38.520 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:38.671 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:25:38.872 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:25:38.890 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:25:38.890 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:25:39.234 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:39.331 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:39.359 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:25:39.576 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:25:39.576 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:25:39.775 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:40.094 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:25:40.162 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:25:40.447 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:25:40.479 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:40.756 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:40.765 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:25:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.034 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.151 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.159 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:25:41.277 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.403 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.461 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:25:41.529 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.655 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.796 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:41.798 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:25:41.905 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:42.031 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:42.083 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:25:42.165 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:25:42.401 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:42.510 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:42.669 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:42.795 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:25:43.093 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:43.671 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2024-08-17T02:25:43.715 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:44.106 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2024-08-17T02:25:44.252 INFO:teuthology.orchestra.run.smithi189.stdout:Adding group ceph....done 2024-08-17T02:25:44.282 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:25:44.451 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:25:44.620 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user ceph....done 2024-08-17T02:25:44.765 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:25:44.787 INFO:teuthology.orchestra.run.smithi189.stdout:Setting system user ceph properties....done 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi189.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:25:44.954 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:25:45.203 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:45.279 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:45.854 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:45.955 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:46.093 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:46.228 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:46.229 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:46.321 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:46.321 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:46.761 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:46.857 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:46.887 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:47.176 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:47.176 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:47.233 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:25:47.675 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:47.830 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:47.920 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:47.920 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:48.190 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:25:48.344 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:48.568 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:48.568 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:48.666 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:48.909 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:48.910 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:48.978 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:49.326 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:49.471 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:49.472 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:49.558 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:49.558 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:49.888 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:49.985 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:50.165 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:50.383 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:50.384 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:50.651 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:50.651 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:50.809 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:50.952 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.078 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.079 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.206 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.237 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:25:51.373 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:51.524 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:25:51.599 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:51.599 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:51.808 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:25:52.050 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:52.218 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:52.343 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:52.486 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:25:52.613 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:25:53.033 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:25:54.661 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:25:55.308 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:25:55.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:25:55.387 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-08-17T02:25:55.603 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-08-17T02:25:55.603 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi155.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi155.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi155.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:25:55.871 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-08-17T02:25:55.872 INFO:teuthology.orchestra.run.smithi155.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:25:55.872 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:25:55.872 INFO:teuthology.orchestra.run.smithi155.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:25:55.872 INFO:teuthology.orchestra.run.smithi155.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:25:55.873 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-08-17T02:25:55.874 INFO:teuthology.orchestra.run.smithi155.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:25:55.949 INFO:teuthology.orchestra.run.smithi155.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:25:55.949 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:25:55.949 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:25:55.949 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:25:55.980 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:25:56.082 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:25:56.083 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:25:56.084 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:25:56.090 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:25:56.090 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:25:56.106 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:25:56.107 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:25:56.109 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:25:56.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:25:56.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:25:56.115 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:25:56.116 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:25:56.118 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:25:56.118 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:25:56.132 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:25:56.133 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:25:56.139 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:25:56.148 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:25:56.148 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:25:56.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:25:56.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:25:56.169 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:25:56.179 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:25:56.194 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:25:56.231 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:25:56.231 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:25:56.231 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:25:56.231 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2024-08-17T02:25:56.581 INFO:teuthology.orchestra.run.smithi189.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:25:56.583 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:25:56.655 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 10.4 MB in 0s (33.0 MB/s) 2024-08-17T02:25:56.660 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-08-17T02:25:56.875 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-08-17T02:25:56.876 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-08-17T02:25:56.923 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:25:56.928 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:25:57.095 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:25:57.096 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:25:57.096 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:25:57.096 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-08-17T02:25:57.096 INFO:teuthology.orchestra.run.smithi189.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:25:57.096 INFO:teuthology.orchestra.run.smithi189.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:25:57.097 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:25:57.097 INFO:teuthology.orchestra.run.smithi189.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:25:57.098 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:25:57.098 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-08-17T02:25:57.098 INFO:teuthology.orchestra.run.smithi189.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:25:57.099 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:25:57.149 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-08-17T02:25:57.150 INFO:teuthology.orchestra.run.smithi189.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:25:57.150 INFO:teuthology.orchestra.run.smithi189.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:25:57.150 INFO:teuthology.orchestra.run.smithi189.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:25:57.151 INFO:teuthology.orchestra.run.smithi189.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:25:57.151 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages will be upgraded: 2024-08-17T02:25:57.153 INFO:teuthology.orchestra.run.smithi189.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:25:57.207 INFO:teuthology.orchestra.run.smithi189.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:25:57.207 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:25:57.207 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:25:57.207 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:25:57.340 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:25:57.341 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:25:57.341 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:25:57.347 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:25:57.348 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:25:57.364 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:25:57.364 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:25:57.366 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:25:57.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:25:57.368 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:25:57.373 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:25:57.374 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:25:57.376 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:25:57.376 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:25:57.390 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:25:57.391 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:25:57.396 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:25:57.405 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:25:57.405 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:25:57.419 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:25:57.419 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:25:57.426 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:25:57.436 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:25:57.454 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:25:57.454 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:25:57.455 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:25:57.455 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:25:57.783 INFO:teuthology.orchestra.run.smithi189.stdout:Preconfiguring packages ... 2024-08-17T02:25:57.918 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 10.4 MB in 0s (35.4 MB/s) 2024-08-17T02:25:58.196 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:25:58.229 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:25:58.234 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:25:58.388 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:25:59.503 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:25:59.574 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:25:59.579 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:25:59.728 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:26:00.125 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:26:00.292 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:26:00.633 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:26:00.979 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:26:00.983 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:26:01.071 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:26:01.075 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:01.145 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:26:01.292 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:26:01.535 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:26:01.689 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:01.734 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:26:01.821 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:26:02.063 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:26:02.334 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:26:02.488 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:26:02.492 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:26:02.493 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:02.626 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:26:02.963 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:26:02.979 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:26:03.012 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:26:03.074 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:03.206 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:26:03.374 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2024-08-17T02:26:03.393 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:26:03.432 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:26:03.707 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:26:03.769 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2024-08-17T02:26:03.786 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:26:03.827 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:26:03.827 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:26:04.146 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:26:04.163 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:26:04.348 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:26:04.367 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:26:04.406 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:26:04.549 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:26:04.566 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:26:04.626 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:26:04.726 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package dump. 2024-08-17T02:26:04.746 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:26:04.801 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:26:04.910 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:04.968 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package indent. 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:26:05.346 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:26:05.363 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:05.508 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:26:05.526 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:26:05.566 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:26:05.717 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:05.757 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:05.878 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:26:05.975 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:26:06.110 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:26:06.127 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:06.248 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:06.515 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:26:06.534 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:26:06.573 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:06.952 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:26:06.969 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:07.010 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:07.271 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:26:07.290 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:07.329 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:26:07.642 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:07.699 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:07.882 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:26:07.901 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:26:08.069 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:26:08.085 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:26:08.127 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:26:08.140 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:26:08.438 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:26:08.455 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:26:08.521 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:08.552 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:26:08.572 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:26:08.610 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:08.874 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:26:08.894 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:08.924 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:26:09.030 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:09.071 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:09.260 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:26:09.280 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:09.318 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:09.432 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:26:09.452 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:09.482 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:09.604 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:26:09.621 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:26:09.785 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:26:09.826 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:10.175 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:26:10.192 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:26:10.258 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:26:10.346 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:26:10.365 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:26:10.404 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:26:10.636 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:26:10.657 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:10.705 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:10.774 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:26:10.793 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:26:10.842 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:11.334 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:26:11.352 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:26:11.488 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:26:11.508 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:26:11.543 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:26:11.546 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:26:12.101 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:26:12.118 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:26:12.141 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:26:12.157 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:26:12.183 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:12.231 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:12.958 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2024-08-17T02:26:12.965 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ppp. 2024-08-17T02:26:12.975 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:26:12.981 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:26:13.238 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:26:13.261 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:26:13.595 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:26:13.612 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:26:13.653 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:26:14.032 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:26:14.051 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:26:14.107 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:26:14.362 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:26:14.382 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:26:14.420 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:26:14.832 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:26:14.849 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:26:14.900 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:26:15.106 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:26:15.125 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:26:15.183 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:26:15.203 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:15.529 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:26:15.559 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:26:15.577 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:26:15.654 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:26:15.655 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:26:15.764 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:26:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:26:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:26:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:26:16.157 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:26:16.157 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:26:16.373 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:26:16.390 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:26:16.442 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:26:16.634 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:26:16.761 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:16.939 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:26:17.087 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:26:17.213 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:26:17.271 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:17.322 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:26:17.397 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:26:17.523 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:17.649 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:26:17.741 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:26:17.741 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:26:18.208 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:26:18.359 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:26:18.485 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:26:18.611 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:26:18.633 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:26:18.737 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:18.863 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:26:18.871 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:26:18.984 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:26:19.048 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:19.174 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:26:19.284 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:26:19.418 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:26:19.595 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:26:19.721 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:19.835 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:26:19.880 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:20.006 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:26:20.052 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:26:20.172 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:26:20.174 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:20.237 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:20.300 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:20.355 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:26:20.464 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:26:20.623 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:26:20.800 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:26:20.934 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout:- enp3s0f1 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:26:21.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:21.085 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:21.159 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:26:21.211 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:26:21.379 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:21.474 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:26:21.530 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:26:21.987 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:26:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:22.190 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:26:22.190 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:26:22.190 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2024-08-17T02:26:22.191 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:26:22.191 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:26:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:22.347 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:26:22.470 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:22.614 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:26:22.659 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:26:22.756 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:22.882 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:23.008 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:23.126 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:23.160 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:26:23.442 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:26:23.442 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:26:23.641 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:26:23.793 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:26:23.936 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:26:23.962 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:26:24.062 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:24.063 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:26:24.196 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:26:24.214 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:26:24.322 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:26:24.365 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:26:24.592 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:26:24.592 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:26:24.658 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:26:25.101 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:26:25.200 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:26:25.335 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:26:25.511 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:26:25.796 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:26:28.561 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:26:28.653 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:26:29.501 INFO:teuthology.orchestra.run.smithi189.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:26:29.506 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:29.690 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:26:29.782 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:26:31.378 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:26:31.383 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:31.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:31.530 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:26:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:26:31.555 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:26:31.555 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:26:31.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:31.705 DEBUG:teuthology.orchestra.run.smithi189:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:26:31.729 INFO:teuthology.orchestra.run.smithi189.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:26:31.729 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:26:31.729 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:26:31.731 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:26:31.731 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:31.731 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:31.748 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:31.748 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:31.763 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:26:31.763 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:31.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:31.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:31.832 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:31.832 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:31.849 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:31.863 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:26:31.864 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:31.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:31.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:31.894 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:31.894 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:31.922 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:31.931 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:31.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:31.947 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:32.004 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:32.004 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:32.020 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:32.035 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:26:32.117 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:26:32.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:32.120 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:32.136 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:26:32.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:32.139 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:32.194 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:26:32.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:32.196 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:32.216 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:26:32.216 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:26:32.216 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:26:32.216 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:32.216 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:32.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:32.306 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:32.306 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:32.313 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:32.356 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:26:32.356 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:26:32.356 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858256', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi189.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:26:32.357 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:32.359 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:32.366 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:32.369 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:32.421 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:32.421 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:32.431 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:32.432 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-08-17 02:22:28.395192896 +0000 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-08-17 02:22:28.159198325 +0000 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-08-17 02:22:28.159198325 +0000 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-08-17T02:26:32.440 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000415362 s, 1.2 MB/s 2024-08-17T02:26:32.452 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:32.459 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:32.466 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:32.466 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.466 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-08-17T02:26:32.466 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.466 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-08-17 02:22:28.807183415 +0000 2024-08-17T02:26:32.467 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-08-17 02:22:28.615187833 +0000 2024-08-17T02:26:32.467 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-08-17 02:22:28.615187833 +0000 2024-08-17T02:26:32.467 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-08-17T02:26:32.467 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:32.478 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-08-17T02:26:32.478 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-08-17T02:26:32.478 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000348415 s, 1.5 MB/s 2024-08-17T02:26:32.480 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:32.530 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:32.536 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:32.536 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-08-17 02:22:29.259173012 +0000 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-08-17 02:22:29.059177615 +0000 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-08-17 02:22:29.059177615 +0000 2024-08-17T02:26:32.537 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-08-17T02:26:32.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:32.549 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-08-17T02:26:32.549 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-08-17T02:26:32.549 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000398091 s, 1.3 MB/s 2024-08-17T02:26:32.550 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:32.558 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:32.565 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:32.565 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.565 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-08-17T02:26:32.565 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.566 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-08-17 02:22:29.691163071 +0000 2024-08-17T02:26:32.566 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-08-17 02:22:29.483167858 +0000 2024-08-17T02:26:32.566 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-08-17 02:22:29.483167858 +0000 2024-08-17T02:26:32.566 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-08-17T02:26:32.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:32.579 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-08-17T02:26:32.579 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-08-17T02:26:32.579 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000401305 s, 1.3 MB/s 2024-08-17T02:26:32.580 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:32.629 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:32.630 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:32.630 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:32.637 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:32.637 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:32.644 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:32.644 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.644 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-08-17T02:26:32.644 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.645 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-08-17 02:22:27.988994600 +0000 2024-08-17T02:26:32.645 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-08-17 02:22:27.984994694 +0000 2024-08-17T02:26:32.645 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-08-17 02:22:27.984994694 +0000 2024-08-17T02:26:32.645 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-08-17T02:26:32.645 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:32.701 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-08-17T02:26:32.702 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-08-17T02:26:32.702 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000440777 s, 1.2 MB/s 2024-08-17T02:26:32.703 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:32.715 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:32.721 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:32.721 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.721 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-08-17T02:26:32.721 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.721 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-08-17 02:22:28.624979942 +0000 2024-08-17T02:26:32.722 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-08-17 02:22:28.408984919 +0000 2024-08-17T02:26:32.722 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-08-17 02:22:28.408984919 +0000 2024-08-17T02:26:32.722 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-08-17T02:26:32.722 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-08-17T02:26:32.776 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000425617 s, 1.2 MB/s 2024-08-17T02:26:32.777 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:32.786 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:32.793 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:32.793 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.793 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-08-17T02:26:32.793 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.794 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-08-17 02:22:29.076969522 +0000 2024-08-17T02:26:32.794 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-08-17 02:22:28.848974777 +0000 2024-08-17T02:26:32.794 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-08-17 02:22:28.848974777 +0000 2024-08-17T02:26:32.794 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-08-17T02:26:32.794 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:32.808 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-08-17T02:26:32.808 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-08-17T02:26:32.809 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000393658 s, 1.3 MB/s 2024-08-17T02:26:32.809 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:32.859 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:32.866 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:32.866 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-08-17 02:22:29.496959841 +0000 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-08-17 02:22:29.304964267 +0000 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-08-17 02:22:29.304964267 +0000 2024-08-17T02:26:32.867 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-08-17T02:26:32.867 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:32.879 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-08-17T02:26:32.879 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-08-17T02:26:32.879 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000369105 s, 1.4 MB/s 2024-08-17T02:26:32.880 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:32.931 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:32.932 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:32.932 INFO:tasks.ceph:Generating config... 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:26:32.933 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:26:32.933 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:26:32.934 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:26:32.935 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:26:32.935 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:26:32.935 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:26:32.935 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:26:32.935 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:32.936 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:26:32.936 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:26:32.936 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:26:32.936 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:26:32.936 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:26:32.936 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:26:32.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:32.972 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:26:32.975 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:26:33.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:33.064 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.155'), ('mon.b', '172.21.15.189'), ('mon.c', '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]')] 2024-08-17T02:26:33.064 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.155,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:26:33.065 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:33.065 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:33.071 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.155 --add b 172.21.15.189 --addv c '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:33.153 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:33.153 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: generated fsid fa54bf99-d4c6-4ed9-b983-a07e3ced1452 2024-08-17T02:26:33.153 INFO:teuthology.orchestra.run.smithi155.stdout:setting min_mon_release = octopus 2024-08-17T02:26:33.153 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 0 2024-08-17T02:26:33.153 INFO:teuthology.orchestra.run.smithi155.stdout:fsid fa54bf99-d4c6-4ed9-b983-a07e3ced1452 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:last_changed 2024-08-17T02:26:33.153525+0000 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:created 2024-08-17T02:26:33.153525+0000 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:min_mon_release 15 (octopus) 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:election_strategy: 1 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:0: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.a 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:2: [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] mon.c 2024-08-17T02:26:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:26:33.155 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:33.162 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fa54bf99-d4c6-4ed9-b983-a07e3ced1452... 2024-08-17T02:26:33.163 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:33.165 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.196 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.197 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:33.198 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-08-17T02:26:33.199 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.155,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = fa54bf99-d4c6-4ed9-b983-a07e3ced1452 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.200 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-08-17T02:26:33.201 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:33.202 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-08-17T02:26:33.203 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-08-17T02:26:33.204 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: debug finisher = 20 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-08-17T02:26:33.205 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:33.206 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:26:33.207 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-08-17T02:26:33.208 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-08-17T02:26:33.209 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-08-17T02:26:33.210 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-08-17T02:26:33.210 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-08-17T02:26:33.210 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-08-17T02:26:33.210 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:33.211 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-08-17T02:26:33.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:33.213 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.155,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-08-17T02:26:33.214 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = fa54bf99-d4c6-4ed9-b983-a07e3ced1452 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.215 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-08-17T02:26:33.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-08-17T02:26:33.217 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-08-17T02:26:33.218 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug finisher = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-08-17T02:26:33.219 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:33.220 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:33.221 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = "" 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-08-17T02:26:33.222 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = True 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = True 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-08-17T02:26:33.223 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-08-17T02:26:33.224 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-08-17T02:26:33.225 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:26:33.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:26:33.315 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:26:33.315 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:33.315 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:26:33.322 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:33.322 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:26:33.331 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:26:33.331 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:33.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:33.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:33.355 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:26:33.355 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:33.404 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:26:33.404 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:33.404 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:33.404 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:33.431 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:26:33.431 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:33.437 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:26:33.437 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:26:33.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:33.482 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:33.484 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:33.529 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:33.534 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:26:33.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:33.585 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:26:33.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:33.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:26:33.659 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:33.705 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:33.707 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:26:33.721 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:33.764 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:26:33.776 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:26:33.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:33.812 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:33.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:33.905 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:33.920 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:33.956 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:33.970 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:34.048 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:34.060 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:26:34.061 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:34.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:34.077 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:34.077 INFO:tasks.ceph:role: osd.0 2024-08-17T02:26:34.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:26:34.077 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:34.589 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:34.590 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:34.591 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:34.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-08-17T02:26:34.592 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:34.692 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:34.704 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:34.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:34.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:34.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:34.715 INFO:tasks.ceph:role: osd.1 2024-08-17T02:26:34.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:26:34.715 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:35.274 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:35.275 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:35.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-08-17T02:26:35.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:35.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:35.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:35.320 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:35.320 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:35.377 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:35.377 INFO:tasks.ceph:role: osd.2 2024-08-17T02:26:35.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:26:35.378 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:35.858 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:35.859 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:35.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-08-17T02:26:35.860 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:35.910 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:35.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:35.923 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:35.936 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:35.936 INFO:tasks.ceph:role: osd.3 2024-08-17T02:26:35.936 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:26:35.936 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:36.438 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:36.438 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:36.438 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:36.438 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:36.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-08-17T02:26:36.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:36.496 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:36.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:36.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.569+0000 7f0b85ba73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.569+0000 7f0b85ba73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:26:36.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.569+0000 7f0b85ba73c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.569+0000 7f0b85ba73c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:36.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.569+0000 7f0b85ba73c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:36.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:36.577+0000 7f0b85ba73c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:26:37.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:37.141+0000 7f0b85ba73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:37.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:37.917+0000 7f0b85ba73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:38.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:38.705+0000 7f0b85ba73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:39.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:39.575 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:39.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:26:39.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:26:39.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:39.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:39.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:39.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:39.609+0000 7fbdd2bab3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:26:40.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:40.177+0000 7fbdd2bab3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:40.977+0000 7fbdd2bab3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:41.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:41.761+0000 7fbdd2bab3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:42.618 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:42.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:42.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:26:42.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:26:42.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:42.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:42.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:42.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:42.713+0000 7f885b7c23c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:26:43.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:43.273+0000 7f885b7c23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:44.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:44.069+0000 7f885b7c23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:44.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:44.849+0000 7f885b7c23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:45.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:45.709 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.741+0000 7fc4a854d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:26:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.745+0000 7fc4a854d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:26:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.745+0000 7fc4a854d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.745+0000 7fc4a854d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.745+0000 7fc4a854d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:45.745+0000 7fc4a854d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:26:46.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:46.305+0000 7fc4a854d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:47.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:47.097+0000 7fc4a854d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:47.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:26:47.885+0000 7fc4a854d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:48.753 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:48.808 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:48.825 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:48.825 INFO:tasks.ceph:role: osd.4 2024-08-17T02:26:48.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:26:48.825 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:49.373 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:49.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-08-17T02:26:49.375 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:49.467 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:49.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:49.480 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:49.481 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:49.496 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:49.496 INFO:tasks.ceph:role: osd.5 2024-08-17T02:26:49.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:26:49.496 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:50.032 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:50.032 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:50.032 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:50.032 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 2024-08-17T02:26:50.032 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:50.033 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:50.033 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:50.033 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:50.033 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:50.033 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:50.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-08-17T02:26:50.034 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:50.068 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:50.078 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:50.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:50.079 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:50.090 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:50.090 INFO:tasks.ceph:role: osd.6 2024-08-17T02:26:50.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:26:50.090 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:50.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-08-17T02:26:50.557 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:50.605 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:50.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:50.617 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:50.618 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:50.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:50.630 INFO:tasks.ceph:role: osd.7 2024-08-17T02:26:50.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:26:50.630 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:51.135 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:51.135 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:51.135 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:51.135 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 2024-08-17T02:26:51.135 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:51.136 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:51.136 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:51.136 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:26:51.136 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:51.136 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:51.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-08-17T02:26:51.137 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:51.202 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:26:51.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:51.213 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:51.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.275+0000 7febadd123c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:26:51.279 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.275+0000 7febadd123c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:26:51.279 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.275+0000 7febadd123c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:51.279 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.275+0000 7febadd123c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:51.279 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.275+0000 7febadd123c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:51.281 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.279+0000 7febadd123c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:26:51.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:51.843+0000 7febadd123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:52.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:52.663+0000 7febadd123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:53.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:53.439+0000 7febadd123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:54.312 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:54.327 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:54.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.359+0000 7f8ffcea73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:26:54.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.359+0000 7f8ffcea73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:26:54.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.359+0000 7f8ffcea73c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:54.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.359+0000 7f8ffcea73c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:54.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.359+0000 7f8ffcea73c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:54.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.363+0000 7f8ffcea73c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:26:54.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:54.923+0000 7f8ffcea73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:55.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:55.703+0000 7f8ffcea73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:56.495+0000 7f8ffcea73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:57.352 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:57.368 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:57.455 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:57.451+0000 7fc6c55123c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:26:58.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:58.015+0000 7fc6c55123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:58.801 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:58.799+0000 7fc6c55123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:26:59.587+0000 7fc6c55123c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:00.456 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:00.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:00.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:27:00.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:27:00.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:00.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:00.507+0000 7f395eb863c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:27:01.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:01.067+0000 7f395eb863c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:01.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:01.843+0000 7f395eb863c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:02.358 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:02.361 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:02.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:02.626+0000 7f395eb863c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:03.487 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:03.503 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:27:03.503 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.504 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:27:03.520 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.520 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:27:03.577 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:27:03.586 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:27:03.601 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.601 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:27:03.610 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.610 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:27:03.669 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:27:03.682 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.682 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:27:03.698 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:27:03.710 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.710 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:27:03.767 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.767 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:27:03.780 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.780 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:27:03.794 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.794 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:27:03.806 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:27:03.816 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.816 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:27:03.823 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:03.823 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:27:03.872 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.872 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:27:03.878 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:03.878 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:27:03.885 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:27:03.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:03.887 DEBUG:teuthology.orchestra.run.smithi189:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBm5+S7HBAA+3bKtHQsHsizdFmKAdBV+g== 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmdIa/IhAASPYHvChuC7XsDnNrPp+r2w== 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmiIA3JhAAi5FgxA5HDGiWOOOATU2MKw== 2024-08-17T02:27:03.898 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBcCsBmVtNJIhAAyms6eFCQcY6D3YZkkiCxgQ== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBfCsBm+6Z1JBAARGmc6GTBhd6EbaA9fBLoYQ== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiCsBmwgWQKhAAuz3k9egfmWcppqxptUZNkw== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBlCsBmXktyLBAAT7mNLvDspCr7Mw3Ug4xwZQ== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmDquGHxAAg0PWcBKXSwJl4b1keWww2g== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmPvIJKhAAoATze8I/tcdNENFt+VviFg== 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-08-17T02:27:03.899 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBm8ZZgLRAAeQpv0GaqjAXkzX7zurZNPA== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBrCsBmI4l4EBAAQQZav2OymcSCfSvJHvBvng== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBuCsBmE96bFRAANJZCawWmiDApBWr85r8hvA== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBxCsBmsXYGGxAASLcUPp4EGpGVxscdwYW75g== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB0CsBmapJZHhAA1Fgyhb98cDfqVZK+9FBobA== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmEw9sMBAAxsk9nYQ90EppDAjADBv6nQ== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmuc4ANhAA3aniaiFafw2jxPVyxdc2ig== 2024-08-17T02:27:03.900 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-08-17T02:27:03.901 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBZCsBmvp/+OBAAsCwELZoYXMpwpn80hPWoIw== 2024-08-17T02:27:03.901 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2024-08-17T02:27:03.901 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBaCsBmHAbcAhAAcQZ7+KivUsKyKOWsVhP/Rg== 2024-08-17T02:27:03.902 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.y] 2024-08-17T02:27:03.902 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBm5+S7HBAA+3bKtHQsHsizdFmKAdBV+g== 2024-08-17T02:27:03.902 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-08-17T02:27:03.902 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmdIa/IhAASPYHvChuC7XsDnNrPp+r2w== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmiIA3JhAAi5FgxA5HDGiWOOOATU2MKw== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.0] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBcCsBmVtNJIhAAyms6eFCQcY6D3YZkkiCxgQ== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.1] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBfCsBm+6Z1JBAARGmc6GTBhd6EbaA9fBLoYQ== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.2] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBiCsBmwgWQKhAAuz3k9egfmWcppqxptUZNkw== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.3] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBlCsBmXktyLBAAT7mNLvDspCr7Mw3Ug4xwZQ== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.x] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmDquGHxAAg0PWcBKXSwJl4b1keWww2g== 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-08-17T02:27:03.903 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmPvIJKhAAoATze8I/tcdNENFt+VviFg== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBm8ZZgLRAAeQpv0GaqjAXkzX7zurZNPA== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.4] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBrCsBmI4l4EBAAQQZav2OymcSCfSvJHvBvng== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.5] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBuCsBmE96bFRAANJZCawWmiDApBWr85r8hvA== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.6] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBxCsBmsXYGGxAASLcUPp4EGpGVxscdwYW75g== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.7] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQB0CsBmapJZHhAA1Fgyhb98cDfqVZK+9FBobA== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmEw9sMBAAxsk9nYQ90EppDAjADBv6nQ== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[client.2] 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmuc4ANhAA3aniaiFafw2jxPVyxdc2ig== 2024-08-17T02:27:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:[client.1] 2024-08-17T02:27:03.905 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBZCsBmvp/+OBAAsCwELZoYXMpwpn80hPWoIw== 2024-08-17T02:27:03.905 INFO:teuthology.orchestra.run.smithi189.stdout:[client.3] 2024-08-17T02:27:03.905 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQBaCsBmHAbcAhAAcQZ7+KivUsKyKOWsVhP/Rg== 2024-08-17T02:27:03.905 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:03.947 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:04.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.024 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.137 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.184 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.186 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.272 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.274 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.321 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.403 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:04.456 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:04.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.502 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.554 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:04.601 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.604 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.648 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.689 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.777 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.780 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:04.822 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:04.825 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:04.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:04.874 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:04.962 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:04.964 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:05.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:05.014 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:05.060 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:27:05.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:05.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:05.123 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:05.135 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:05.152 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:05.208 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:05.221 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:05.236 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:05.291 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:05.303 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:05.306 DEBUG:teuthology.orchestra.run.smithi189:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:05.357 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:27:05.358 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:27:05.358 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:27:05.360 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:27:05.360 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:27:05.360 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:27:05.363 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:27:05.363 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:27:05.363 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:27:05.365 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:27:05.365 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:27:05.365 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:27:05.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:27:05.367 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:27:05.368 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:27:05.368 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:27:05.370 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:27:05.370 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:27:05.370 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:27:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.477+0000 7f8d29b79700 1 Processor -- start 2024-08-17T02:27:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.477+0000 7f8d29b79700 1 -- start start 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d29b79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d29b79700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d29b79700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2406b000 con 0x7f8d24069ee0 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d29b79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2406a3f0 con 0x7f8d241554c0 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d29b79700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2406a6d0 con 0x7f8d24068db0 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54738/0 (socket says 172.21.15.155:54738) 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 learned_addr learned my addr 172.21.15.155:0/3440277717 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:05.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 msgr2=0x7f8d240699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 msgr2=0x7f8d240699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d23fff700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 msgr2=0x7f8d2406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d23fff700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 msgr2=0x7f8d2406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:05.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.481+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d23fff700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 msgr2=0x7f8d2406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d23fff700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 msgr2=0x7f8d2406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 msgr2=0x7f8d240699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 msgr2=0x7f8d240699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.685+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:05.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.701+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910006698 0 0) 0x7f8d2406b000 con 0x7f8d24069ee0 2024-08-17T02:27:05.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.701+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d0c003570 con 0x7f8d24069ee0 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155472097 0 0) 0x7f8d0c003570 con 0x7f8d24069ee0 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 msgr2=0x7f8d2406b490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.189:3300/0 conn(0x7f8d24068db0 0x7f8d2406b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 msgr2=0x7f8d240699a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 --2- 172.21.15.155:0/3440277717 >> v2:172.21.15.155:3300/0 conn(0x7f8d241554c0 0x7f8d240699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2406a9b0 con 0x7f8d24069ee0 2024-08-17T02:27:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f8d18001470 con 0x7f8d24069ee0 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 >> v1:172.21.15.189:6789/0 conn(0x7f8d24069ee0 legacy=0x7f8d240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 0x7f8d0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c004810 0x7f8d0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d0c0051c0 0x7f8d0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2406a3f0 con 0x7f8d0c004810 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2406a6d0 con 0x7f8d0c0051c0 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c00c130 con 0x7f8d0c003a60 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 0x7f8d0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d22ffd700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c004810 0x7f8d0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d0c0051c0 0x7f8d0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d0c0051c0 msgr2=0x7f8d0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d0c0051c0 0x7f8d0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c004810 msgr2=0x7f8d0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c004810 0x7f8d0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 -- 172.21.15.155:0/3440277717 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c003570 con 0x7f8d0c003a60 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d23fff700 1 -- 172.21.15.155:0/3440277717 reap_dead start 2024-08-17T02:27:05.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.705+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 0x7f8d0c003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400b300 tx=0x7f8d1400b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ff826c5b99f38d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14010ad0 con 0x7f8d0c003a60 2024-08-17T02:27:05.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14015070 con 0x7f8d0c003a60 2024-08-17T02:27:05.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d227fc700 1 -- 172.21.15.155:0/3440277717 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14010c70 con 0x7f8d0c003a60 2024-08-17T02:27:05.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 -- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 msgr2=0x7f8d0c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 0x7f8d0c003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400b300 tx=0x7f8d1400b540 comp rx=0 tx=0).stop 2024-08-17T02:27:05.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 -- 172.21.15.155:0/3440277717 shutdown_connections 2024-08-17T02:27:05.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3440277717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d0c003a60 0x7f8d0c003e70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 -- 172.21.15.155:0/3440277717 >> 172.21.15.155:0/3440277717 conn(0x7f8d240c9bf0 msgr2=0x7f8d2406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 -- 172.21.15.155:0/3440277717 shutdown_connections 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.709+0000 7f8d29b79700 1 -- 172.21.15.155:0/3440277717 wait complete. 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 Processor -- start 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 -- start start 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d240b0920 0x7f8d240b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d24155b50 0x7f8d24155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240b12d0 con 0x7f8d0c003a60 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24157540 con 0x7f8d240b0920 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d29b79700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24156910 con 0x7f8d24155b50 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54802/0 (socket says 172.21.15.155:54802) 2024-08-17T02:27:05.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 -- 172.21.15.155:0/3804819308 learned_addr learned my addr 172.21.15.155:0/3804819308 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d22ffd700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d240b0920 0x7f8d240b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d23fff700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d24155b50 0x7f8d24155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 -- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d24155b50 msgr2=0x7f8d24155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d24155b50 0x7f8d24155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 -- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d240b0920 msgr2=0x7f8d240b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d240b0920 0x7f8d240b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.713+0000 7f8d237fe700 1 -- 172.21.15.155:0/3804819308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24156ef0 con 0x7f8d0c003a60 2024-08-17T02:27:05.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d237fe700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c2c0 tx=0x7f8d14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14011600 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14011760 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d241571d0 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14011b00 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d24156500 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8d14017030 con 0x7f8d0c003a60 2024-08-17T02:27:05.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d14021070 con 0x7f8d0c003a60 2024-08-17T02:27:05.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.717+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d240645c0 con 0x7f8d0c003a60 2024-08-17T02:27:05.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.721+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8d14029070 con 0x7f8d0c003a60 2024-08-17T02:27:05.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.789+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8d2406e870 con 0x7f8d0c003a60 2024-08-17T02:27:05.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d0b7fe700 1 -- 172.21.15.155:0/3804819308 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8d1402eaa0 con 0x7f8d0c003a60 2024-08-17T02:27:05.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 msgr2=0x7f8d240c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c2c0 tx=0x7f8d14018000 comp rx=0 tx=0).stop 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 shutdown_connections 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8d24155b50 0x7f8d24155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d240b0920 0x7f8d240b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 --2- 172.21.15.155:0/3804819308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c003a60 0x7f8d240c7f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 >> 172.21.15.155:0/3804819308 conn(0x7f8d240c9bf0 msgr2=0x7f8d2406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 shutdown_connections 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:05.797+0000 7f8d29b79700 1 -- 172.21.15.155:0/3804819308 wait complete. 2024-08-17T02:27:05.800 INFO:teuthology.orchestra.run.smithi155.stderr:adjusted tunables profile to default 2024-08-17T02:27:05.812 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:27:05.812 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:05.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:27:05.827 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:05.827 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:27:05.839 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:05.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:27:05.851 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-08-17T02:27:05.851 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:27:05.865 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:05.865 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:27:05.882 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:05.882 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:27:05.904 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:05.902+0000 7f8a232c6000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:05.906 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:05.905+0000 7f74ac785000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:05.916 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:05.916 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:27:05.975 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-08-17T02:27:05.975 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:27:05.984 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new c03ba931-eec1-4b1d-9254-59f448cd598d 0 2024-08-17T02:27:06.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.090+0000 7fee96b25700 1 Processor -- start 2024-08-17T02:27:06.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.090+0000 7fee96b25700 1 -- start start 2024-08-17T02:27:06.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 0x7fee90068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900ab0f0 con 0x7fee90158b70 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900ab3d0 con 0x7fee900688d0 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900ab6b0 con 0x7fee900aab10 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95322700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 0x7fee90068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95b23700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fee900688d0 0x7fee90066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39194/0 (socket says 172.21.15.189:39194) 2024-08-17T02:27:06.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95b23700 1 -- 172.21.15.189:0/1000696606 learned_addr learned my addr 172.21.15.189:0/1000696606 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-08-17T02:27:06.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee94b21700 1 -- 172.21.15.189:0/1000696606 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638762502 0 0) 0x7fee900ab3d0 con 0x7fee900688d0 2024-08-17T02:27:06.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee94b21700 1 -- 172.21.15.189:0/1000696606 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c003570 con 0x7fee900688d0 2024-08-17T02:27:06.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95322700 1 -- 172.21.15.189:0/1000696606 >> v1:172.21.15.189:6789/0 conn(0x7fee900688d0 legacy=0x7fee90066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95322700 1 -- 172.21.15.189:0/1000696606 >> v1:172.21.15.155:6789/0 conn(0x7fee90158b70 legacy=0x7fee90158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95322700 1 -- 172.21.15.189:0/1000696606 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900ab990 con 0x7fee900aab10 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee95322700 1 --2- 172.21.15.189:0/1000696606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 0x7fee90068ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee80009910 tx=0x7fee800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692f5e1324d69ea1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee94b21700 1 -- 172.21.15.189:0/1000696606 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000b680 con 0x7fee900aab10 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee94b21700 1 -- 172.21.15.189:0/1000696606 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000b7e0 con 0x7fee900aab10 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee94b21700 1 -- 172.21.15.189:0/1000696606 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000bba0 con 0x7fee900aab10 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- 172.21.15.189:0/1000696606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 msgr2=0x7fee90068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 --2- 172.21.15.189:0/1000696606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 0x7fee90068ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee80009910 tx=0x7fee800091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- 172.21.15.189:0/1000696606 shutdown_connections 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 --2- 172.21.15.189:0/1000696606 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900aab10 0x7fee90068ca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- 172.21.15.189:0/1000696606 >> 172.21.15.189:0/1000696606 conn(0x7fee9006e310 msgr2=0x7fee9006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- 172.21.15.189:0/1000696606 shutdown_connections 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- 172.21.15.189:0/1000696606 wait complete. 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 Processor -- start 2024-08-17T02:27:06.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.094+0000 7fee96b25700 1 -- start start 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 0x7fee9015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee90158b70 0x7fee90155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015f1f0 con 0x7fee900aab10 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015f4d0 con 0x7fee90158b70 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015f7b0 con 0x7fee900688d0 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96324700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee90158b70 0x7fee90155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58590/0 (socket says 172.21.15.189:58590) 2024-08-17T02:27:06.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 -- 172.21.15.189:0/3107616124 learned_addr learned my addr 172.21.15.189:0/3107616124 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95322700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 0x7fee9015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 -- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee90158b70 msgr2=0x7fee90155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee90158b70 0x7fee90155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 -- 172.21.15.189:0/3107616124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 msgr2=0x7fee9015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 0x7fee9015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 -- 172.21.15.189:0/3107616124 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009420 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95322700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 0x7fee9015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee95b23700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c7c0 tx=0x7fee8c007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c005b30 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c005cb0 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9015fa90 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c007320 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90156190 con 0x7fee900688d0 2024-08-17T02:27:06.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fee8c01c440 con 0x7fee900688d0 2024-08-17T02:27:06.105 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fee8c012750 con 0x7fee900688d0 2024-08-17T02:27:06.105 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.098+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee900638f0 con 0x7fee900688d0 2024-08-17T02:27:06.106 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.102+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fee8c017070 con 0x7fee900688d0 2024-08-17T02:27:06.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.178+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c03ba931-eec1-4b1d-9254-59f448cd598d", "id": 0} v 0) v1 -- 0x7fee90068290 con 0x7fee900688d0 2024-08-17T02:27:06.187 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.182+0000 7fee85ffb700 1 -- 172.21.15.189:0/3107616124 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c03ba931-eec1-4b1d-9254-59f448cd598d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee8c005e20 con 0x7fee900688d0 2024-08-17T02:27:06.187 INFO:teuthology.orchestra.run.smithi189.stdout:0 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 msgr2=0x7fee900cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c7c0 tx=0x7fee8c007e00 comp rx=0 tx=0).stop 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 shutdown_connections 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee90158b70 0x7fee90155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee900aab10 0x7fee9015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 --2- 172.21.15.189:0/3107616124 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fee900688d0 0x7fee900cbdb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 >> 172.21.15.189:0/3107616124 conn(0x7fee9006e310 msgr2=0x7fee900b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 shutdown_connections 2024-08-17T02:27:06.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.186+0000 7fee96b25700 1 -- 172.21.15.189:0/3107616124 wait complete. 2024-08-17T02:27:06.201 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new f3ee7bae-60bd-4fc1-ad90-accd0612d750 1 2024-08-17T02:27:06.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.302+0000 7fb072f98700 1 Processor -- start 2024-08-17T02:27:06.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.302+0000 7fb072f98700 1 -- start start 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb06c159fb0 0x7fb06c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0ac7f0 con 0x7fb06c159be0 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0c8580 con 0x7fb06c159fb0 2024-08-17T02:27:06.310 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0c8860 con 0x7fb06c155820 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb071f96700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb06c159be0 0x7fb06c0c7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39206/0 (socket says 172.21.15.189:39206) 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb071f96700 1 -- 172.21.15.189:0/2618895164 learned_addr learned my addr 172.21.15.189:0/2618895164 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb071795700 1 --2- 172.21.15.189:0/2618895164 >> v2:172.21.15.155:3300/0 conn(0x7fb06c159fb0 0x7fb06c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb070f94700 1 -- 172.21.15.189:0/2618895164 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691799196 0 0) 0x7fb06c0ac7f0 con 0x7fb06c159be0 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb070f94700 1 -- 172.21.15.189:0/2618895164 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb058003570 con 0x7fb06c159be0 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 -- 172.21.15.189:0/2618895164 >> v2:172.21.15.155:3300/0 conn(0x7fb06c159fb0 msgr2=0x7fb06c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 --2- 172.21.15.189:0/2618895164 >> v2:172.21.15.155:3300/0 conn(0x7fb06c159fb0 0x7fb06c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 -- 172.21.15.189:0/2618895164 >> v1:172.21.15.189:6789/0 conn(0x7fb06c159be0 legacy=0x7fb06c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 -- 172.21.15.189:0/2618895164 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0c8b40 con 0x7fb06c155820 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072797700 1 --2- 172.21.15.189:0/2618895164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c155c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb064009e60 tx=0x7fb064009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e54db7390d6ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.311 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb070f94700 1 -- 172.21.15.189:0/2618895164 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400e070 con 0x7fb06c155820 2024-08-17T02:27:06.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb070f94700 1 -- 172.21.15.189:0/2618895164 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400bab0 con 0x7fb06c155820 2024-08-17T02:27:06.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb070f94700 1 -- 172.21.15.189:0/2618895164 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400be70 con 0x7fb06c155820 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- 172.21.15.189:0/2618895164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 msgr2=0x7fb06c155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 --2- 172.21.15.189:0/2618895164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c155c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb064009e60 tx=0x7fb064009780 comp rx=0 tx=0).stop 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- 172.21.15.189:0/2618895164 shutdown_connections 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 --2- 172.21.15.189:0/2618895164 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c155c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 --2- 172.21.15.189:0/2618895164 >> v2:172.21.15.155:3300/0 conn(0x7fb06c159fb0 0x7fb06c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- 172.21.15.189:0/2618895164 >> 172.21.15.189:0/2618895164 conn(0x7fb06c0c9830 msgr2=0x7fb06c0c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- 172.21.15.189:0/2618895164 shutdown_connections 2024-08-17T02:27:06.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.306+0000 7fb072f98700 1 -- 172.21.15.189:0/2618895164 wait complete. 2024-08-17T02:27:06.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 Processor -- start 2024-08-17T02:27:06.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 -- start start 2024-08-17T02:27:06.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb06c159fb0 0x7fb06c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c157890 con 0x7fb06c159fb0 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0c6c80 con 0x7fb06c159be0 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072f98700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c1569e0 con 0x7fb06c155820 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071f96700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36514/0 (socket says 172.21.15.189:36514) 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 -- 172.21.15.189:0/261929701 learned_addr learned my addr 172.21.15.189:0/261929701 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb072797700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb06c159fb0 0x7fb06c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 -- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 msgr2=0x7fb06c153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 -- 172.21.15.189:0/261929701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb06c159fb0 msgr2=0x7fb06c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb06c159fb0 0x7fb06c1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071795700 1 -- 172.21.15.189:0/261929701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009a20 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.310+0000 7fb071f96700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb071795700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb05c010b40 tx=0x7fb05c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00ea60 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c00ebc0 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c156c80 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011450 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c157240 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb05c005a00 con 0x7fb06c159be0 2024-08-17T02:27:06.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb05c006020 con 0x7fb06c159be0 2024-08-17T02:27:06.319 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.314+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c0638f0 con 0x7fb06c159be0 2024-08-17T02:27:06.320 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.318+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb05c01e070 con 0x7fb06c159be0 2024-08-17T02:27:06.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.398+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3ee7bae-60bd-4fc1-ad90-accd0612d750", "id": 1} v 0) v1 -- 0x7fb06c0c9170 con 0x7fb06c159be0 2024-08-17T02:27:06.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb061ffb700 1 -- 172.21.15.189:0/261929701 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3ee7bae-60bd-4fc1-ad90-accd0612d750", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb05c006260 con 0x7fb06c159be0 2024-08-17T02:27:06.409 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-08-17T02:27:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 msgr2=0x7fb06c0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb05c010b40 tx=0x7fb05c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 shutdown_connections 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb06c159fb0 0x7fb06c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb06c159be0 0x7fb06c0c6740 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 --2- 172.21.15.189:0/261929701 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb06c155820 0x7fb06c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 >> 172.21.15.189:0/261929701 conn(0x7fb06c0c9830 msgr2=0x7fb06c0c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 shutdown_connections 2024-08-17T02:27:06.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.406+0000 7fb072f98700 1 -- 172.21.15.189:0/261929701 wait complete. 2024-08-17T02:27:06.422 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new a3056522-7876-479c-b2b5-f15703b32ff7 2 2024-08-17T02:27:06.528 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 Processor -- start 2024-08-17T02:27:06.528 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- start start 2024-08-17T02:27:06.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 0x7f9d680b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680adb00 con 0x7f9d681597d0 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6806bf60 con 0x7f9d68159400 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680ac630 con 0x7f9d6806bac0 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58608/0 (socket says 172.21.15.189:58608) 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 -- 172.21.15.189:0/175533995 learned_addr learned my addr 172.21.15.189:0/175533995 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6d525700 1 --2- 172.21.15.189:0/175533995 >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 0x7f9d680b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 -- 172.21.15.189:0/175533995 >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 msgr2=0x7f9d680b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 --2- 172.21.15.189:0/175533995 >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 0x7f9d680b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 -- 172.21.15.189:0/175533995 >> v1:172.21.15.155:6789/0 conn(0x7f9d681597d0 legacy=0x7f9d680ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 -- 172.21.15.189:0/175533995 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680ac910 con 0x7f9d6806bac0 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6d525700 1 --2- 172.21.15.189:0/175533995 >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 0x7f9d680b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6dd26700 1 --2- 172.21.15.189:0/175533995 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009f20 tx=0x7f9d60009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981ff038512ac16b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d5ffff700 1 -- 172.21.15.189:0/175533995 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000e070 con 0x7f9d6806bac0 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d5ffff700 1 -- 172.21.15.189:0/175533995 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6000ba40 con 0x7f9d6806bac0 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d5ffff700 1 -- 172.21.15.189:0/175533995 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600092e0 con 0x7f9d6806bac0 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- 172.21.15.189:0/175533995 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 msgr2=0x7f9d680686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 --2- 172.21.15.189:0/175533995 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009f20 tx=0x7f9d60009840 comp rx=0 tx=0).stop 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- 172.21.15.189:0/175533995 shutdown_connections 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 --2- 172.21.15.189:0/175533995 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680686a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 --2- 172.21.15.189:0/175533995 >> v2:172.21.15.155:3300/0 conn(0x7f9d68159400 0x7f9d680b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- 172.21.15.189:0/175533995 >> 172.21.15.189:0/175533995 conn(0x7f9d680c9bf0 msgr2=0x7f9d6806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- 172.21.15.189:0/175533995 shutdown_connections 2024-08-17T02:27:06.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.526+0000 7f9d6f789700 1 -- 172.21.15.189:0/175533995 wait complete. 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 Processor -- start 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- start start 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 0x7f9d6814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6814b740 con 0x7f9d68159400 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c6bc0 con 0x7f9d681597d0 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c5fb0 con 0x7f9d6806bac0 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6d525700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36526/0 (socket says 172.21.15.189:36526) 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6d525700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58612/0 (socket says 172.21.15.189:58612) 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 -- 172.21.15.189:0/198751836 learned_addr learned my addr 172.21.15.189:0/198751836 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6cd24700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 0x7f9d6814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 -- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 msgr2=0x7f9d680c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 -- 172.21.15.189:0/198751836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 msgr2=0x7f9d6814b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 0x7f9d6814b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 -- 172.21.15.189:0/198751836 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60009ae0 con 0x7f9d681597d0 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6cd24700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 0x7f9d6814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6dd26700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d680710e0 tx=0x7f9d60017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600032f0 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60012db0 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d680c6290 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6001d670 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d680c6850 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9d6001da60 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.530+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9d6001dd10 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.534+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d680645c0 con 0x7f9d681597d0 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.534+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9d6002a060 con 0x7f9d681597d0 2024-08-17T02:27:06.612 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.610+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a3056522-7876-479c-b2b5-f15703b32ff7", "id": 2} v 0) v1 -- 0x7f9d680b1dd0 con 0x7f9d681597d0 2024-08-17T02:27:06.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.614+0000 7f9d5d7fa700 1 -- 172.21.15.189:0/198751836 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a3056522-7876-479c-b2b5-f15703b32ff7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d60017070 con 0x7f9d681597d0 2024-08-17T02:27:06.619 INFO:teuthology.orchestra.run.smithi189.stdout:2 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 msgr2=0x7f9d680a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d680710e0 tx=0x7f9d60017000 comp rx=0 tx=0).stop 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 shutdown_connections 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d681597d0 0x7f9d680a6de0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d68159400 0x7f9d6814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 --2- 172.21.15.189:0/198751836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d6806bac0 0x7f9d680c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 >> 172.21.15.189:0/198751836 conn(0x7f9d680c9bf0 msgr2=0x7f9d6806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 shutdown_connections 2024-08-17T02:27:06.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.618+0000 7f9d6f789700 1 -- 172.21.15.189:0/198751836 wait complete. 2024-08-17T02:27:06.632 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 363321d2-aa80-4ce5-ac56-436ed03a3d61 3 2024-08-17T02:27:06.635 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:06.633+0000 7f74ac785000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:06.657 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:06.654+0000 7f8a232c6000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:06.691 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:06.689+0000 7f74ac785000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:06.720 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:06.718+0000 7f8a232c6000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:06.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 Processor -- start 2024-08-17T02:27:06.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 -- start start 2024-08-17T02:27:06.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5560068db0 0x7f5560159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55600c8b70 0x7f55600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556006a3b0 con 0x7f5560158fb0 2024-08-17T02:27:06.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5560069ee0 con 0x7f55600c8b70 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5566bb7700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600c9010 con 0x7f5560068db0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5560068db0 0x7f5560159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5560068db0 0x7f5560159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36532/0 (socket says 172.21.15.189:36532) 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 -- 172.21.15.189:0/3335979537 learned_addr learned my addr 172.21.15.189:0/3335979537 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f5565154700 1 --2- 172.21.15.189:0/3335979537 >> v2:172.21.15.155:3300/0 conn(0x7f55600c8b70 0x7f55600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 -- 172.21.15.189:0/3335979537 >> v2:172.21.15.155:3300/0 conn(0x7f55600c8b70 msgr2=0x7f55600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 --2- 172.21.15.189:0/3335979537 >> v2:172.21.15.155:3300/0 conn(0x7f55600c8b70 0x7f55600699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 -- 172.21.15.189:0/3335979537 >> v1:172.21.15.155:6789/0 conn(0x7f5560158fb0 legacy=0x7f55600686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 -- 172.21.15.189:0/3335979537 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600a9fe0 con 0x7f5560068db0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555ffff700 1 --2- 172.21.15.189:0/3335979537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5560068db0 0x7f5560159380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f556006d6e0 tx=0x7f554c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca4aa3f0ab7ad502 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555f7fe700 1 -- 172.21.15.189:0/3335979537 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c009e70 con 0x7f5560068db0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555f7fe700 1 -- 172.21.15.189:0/3335979537 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00b860 con 0x7f5560068db0 2024-08-17T02:27:06.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.726+0000 7f555f7fe700 1 -- 172.21.15.189:0/3335979537 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00bc00 con 0x7f5560068db0 2024-08-17T02:27:06.733 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- 172.21.15.189:0/3335979537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5560068db0 msgr2=0x7f5560159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.733 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3335979537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5560068db0 0x7f5560159380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f556006d6e0 tx=0x7f554c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:06.733 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- 172.21.15.189:0/3335979537 shutdown_connections 2024-08-17T02:27:06.733 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3335979537 >> v2:172.21.15.155:3300/0 conn(0x7f55600c8b70 0x7f55600699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3335979537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5560068db0 0x7f5560159380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- 172.21.15.189:0/3335979537 >> 172.21.15.189:0/3335979537 conn(0x7f55600c9bf0 msgr2=0x7f556006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- 172.21.15.189:0/3335979537 shutdown_connections 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- 172.21.15.189:0/3335979537 wait complete. 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 Processor -- start 2024-08-17T02:27:06.734 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- start start 2024-08-17T02:27:06.736 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5560068db0 0x7f5560169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.736 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.736 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 0x7f55601577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.736 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556016a4f0 con 0x7f5560158fb0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556015b720 con 0x7f55600c8b70 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5566bb7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556015d080 con 0x7f5560068db0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5564953700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5560068db0 0x7f5560169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36546/0 (socket says 172.21.15.189:36546) 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 -- 172.21.15.189:0/3487742802 learned_addr learned my addr 172.21.15.189:0/3487742802 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f5565154700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 0x7f55601577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 -- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5560068db0 msgr2=0x7f5560169fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5560068db0 0x7f5560169fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 -- 172.21.15.189:0/3487742802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 msgr2=0x7f55601577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.730+0000 7f555ffff700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 0x7f55601577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555ffff700 1 -- 172.21.15.189:0/3487742802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0094f0 con 0x7f55600c8b70 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f5565154700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 0x7f55601577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555ffff700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55600a9f70 tx=0x7f554c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.737 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00b9d0 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00bb30 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c025670 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600ab250 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556015b0d0 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f554c023070 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f554c025e10 con 0x7f55600c8b70 2024-08-17T02:27:06.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600645c0 con 0x7f55600c8b70 2024-08-17T02:27:06.739 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.734+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f554c015020 con 0x7f55600c8b70 2024-08-17T02:27:06.808 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:06.805+0000 7f74ac785000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:06.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.810+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "363321d2-aa80-4ce5-ac56-436ed03a3d61", "id": 3} v 0) v1 -- 0x7f556015b860 con 0x7f55600c8b70 2024-08-17T02:27:06.821 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f555cff9700 1 -- 172.21.15.189:0/3487742802 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "363321d2-aa80-4ce5-ac56-436ed03a3d61", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f554c011420 con 0x7f55600c8b70 2024-08-17T02:27:06.821 INFO:teuthology.orchestra.run.smithi189.stdout:3 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 msgr2=0x7f5560147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55600a9f70 tx=0x7f554c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 shutdown_connections 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560158fb0 0x7f55601577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55600c8b70 0x7f5560147220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 --2- 172.21.15.189:0/3487742802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5560068db0 0x7f5560169fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 >> 172.21.15.189:0/3487742802 conn(0x7f55600c9bf0 msgr2=0x7f556006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 shutdown_connections 2024-08-17T02:27:06.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.818+0000 7f5566bb7700 1 -- 172.21.15.189:0/3487742802 wait complete. 2024-08-17T02:27:06.834 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new a36fcda1-cea7-4f09-9a2f-1673f034d1f1 4 2024-08-17T02:27:06.838 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:06.834+0000 7f8a232c6000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:06.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 Processor -- start 2024-08-17T02:27:06.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 -- start start 2024-08-17T02:27:06.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f615415a8d0 0x7f61540686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540b1540 con 0x7f61540b2250 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615406ed10 con 0x7f615415a8d0 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6159707700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540b1dc0 con 0x7f615415a500 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.938+0000 7f6152ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58628/0 (socket says 172.21.15.189:58628) 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f61537fe700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f61540b2250 0x7f61540699a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39212/0 (socket says 172.21.15.189:39212) 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 -- 172.21.15.189:0/3974958952 learned_addr learned my addr 172.21.15.189:0/3974958952 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f61527fc700 1 --2- 172.21.15.189:0/3974958952 >> v2:172.21.15.155:3300/0 conn(0x7f615415a8d0 0x7f61540686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 -- 172.21.15.189:0/3974958952 >> v2:172.21.15.155:3300/0 conn(0x7f615415a8d0 msgr2=0x7f61540686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 --2- 172.21.15.189:0/3974958952 >> v2:172.21.15.155:3300/0 conn(0x7f615415a8d0 0x7f61540686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 -- 172.21.15.189:0/3974958952 >> v1:172.21.15.189:6789/0 conn(0x7f61540b2250 legacy=0x7f61540699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 -- 172.21.15.189:0/3974958952 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615406ea30 con 0x7f615415a500 2024-08-17T02:27:06.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6152ffd700 1 --2- 172.21.15.189:0/3974958952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f61440099b0 tx=0x7f6144009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c71403d349c170af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6151ffb700 1 -- 172.21.15.189:0/3974958952 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144009ea0 con 0x7f615415a500 2024-08-17T02:27:06.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6151ffb700 1 -- 172.21.15.189:0/3974958952 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400b860 con 0x7f615415a500 2024-08-17T02:27:06.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6151ffb700 1 -- 172.21.15.189:0/3974958952 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400bc00 con 0x7f615415a500 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- 172.21.15.189:0/3974958952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 msgr2=0x7f61540ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- 172.21.15.189:0/3974958952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f61440099b0 tx=0x7f6144009250 comp rx=0 tx=0).stop 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- 172.21.15.189:0/3974958952 shutdown_connections 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- 172.21.15.189:0/3974958952 >> v2:172.21.15.155:3300/0 conn(0x7f615415a8d0 0x7f61540686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- 172.21.15.189:0/3974958952 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ae830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- 172.21.15.189:0/3974958952 >> 172.21.15.189:0/3974958952 conn(0x7f61540c9bf0 msgr2=0x7f615406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- 172.21.15.189:0/3974958952 shutdown_connections 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- 172.21.15.189:0/3974958952 wait complete. 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 Processor -- start 2024-08-17T02:27:06.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- start start 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61540b2250 0x7f615414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 0x7f61540a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540cb080 con 0x7f615415a8d0 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540ad030 con 0x7f61540b2250 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f6159707700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540ac420 con 0x7f615415a500 2024-08-17T02:27:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.942+0000 7f61527fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58634/0 (socket says 172.21.15.189:58634) 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 -- 172.21.15.189:0/797093652 learned_addr learned my addr 172.21.15.189:0/797093652 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f6152ffd700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61540b2250 0x7f615414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61537fe700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 0x7f61540a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 -- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61540b2250 msgr2=0x7f615414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61540b2250 0x7f615414ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 -- 172.21.15.189:0/797093652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 msgr2=0x7f61540a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 0x7f61540a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 -- 172.21.15.189:0/797093652 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440094f0 con 0x7f615415a500 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61537fe700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 0x7f61540a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f61527fc700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f614800e930 tx=0x7f61480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148013680 con 0x7f615415a500 2024-08-17T02:27:06.951 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61480137e0 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61540ac700 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148013b80 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61540accc0 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6148005a00 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f6148006850 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.946+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61540645c0 con 0x7f615415a500 2024-08-17T02:27:06.952 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:06.950+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6148021060 con 0x7f615415a500 2024-08-17T02:27:07.030 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.026+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a36fcda1-cea7-4f09-9a2f-1673f034d1f1", "id": 4} v 0) v1 -- 0x7f6154150460 con 0x7f615415a500 2024-08-17T02:27:07.032 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.029+0000 7f74ac785000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:07.039 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.034+0000 7f613affd700 1 -- 172.21.15.189:0/797093652 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a36fcda1-cea7-4f09-9a2f-1673f034d1f1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6148029020 con 0x7f615415a500 2024-08-17T02:27:07.040 INFO:teuthology.orchestra.run.smithi189.stdout:4 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 msgr2=0x7f61540ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f614800e930 tx=0x7f61480091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 shutdown_connections 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f615415a8d0 0x7f61540a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f615415a500 0x7f61540ad960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 --2- 172.21.15.189:0/797093652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61540b2250 0x7f615414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 >> 172.21.15.189:0/797093652 conn(0x7f61540c9bf0 msgr2=0x7f615406a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 shutdown_connections 2024-08-17T02:27:07.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.038+0000 7f6159707700 1 -- 172.21.15.189:0/797093652 wait complete. 2024-08-17T02:27:07.054 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new ad789d88-7793-43a5-88b9-9acfed2ca06d 5 2024-08-17T02:27:07.081 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.077+0000 7f74ac785000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:07.083 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.078+0000 7f8a232c6000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:07.135 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.130+0000 7f8a232c6000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:07.161 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 Processor -- start 2024-08-17T02:27:07.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 -- start start 2024-08-17T02:27:07.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0a815d2a0 0x7fb0a80ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80ad5f0 con 0x7fb0a8068db0 2024-08-17T02:27:07.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80ae8b0 con 0x7fb0a815d670 2024-08-17T02:27:07.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80b26c0 con 0x7fb0a815d2a0 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a5d9b700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb0a815d670 0x7fb0a80686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39222/0 (socket says 172.21.15.189:39222) 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/2543646254 learned_addr learned my addr 172.21.15.189:0/2543646254 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a659c700 1 --2- 172.21.15.189:0/2543646254 >> v2:172.21.15.155:3300/0 conn(0x7fb0a815d2a0 0x7fb0a80ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179610319 0 0) 0x7fb0a80ae8b0 con 0x7fb0a815d670 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb090003570 con 0x7fb0a815d670 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110659428 0 0) 0x7fb0a80ad5f0 con 0x7fb0a8068db0 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.158+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a80ae8b0 con 0x7fb0a8068db0 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172529941 0 0) 0x7fb090003570 con 0x7fb0a815d670 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 >> v2:172.21.15.155:3300/0 conn(0x7fb0a815d2a0 msgr2=0x7fb0a80ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 --2- 172.21.15.189:0/2543646254 >> v2:172.21.15.155:3300/0 conn(0x7fb0a815d2a0 0x7fb0a80ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 >> v1:172.21.15.155:6789/0 conn(0x7fb0a8068db0 legacy=0x7fb0a80b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80ad890 con 0x7fb0a815d670 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fb09c001470 con 0x7fb0a815d670 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a659c700 1 --2- 172.21.15.189:0/2543646254 >> v2:172.21.15.155:3300/0 conn(0x7fb0a815d2a0 0x7fb0a80ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 >> v1:172.21.15.189:6789/0 conn(0x7fb0a815d670 legacy=0x7fb0a80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb090004c50 0x7fb090005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb090003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb090004160 0x7fb09000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80b26c0 con 0x7fb090004160 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09000c0b0 con 0x7fb0900037b0 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09000c270 con 0x7fb090004c50 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a659c700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb090004c50 0x7fb090005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb090003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a6d9d700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb090004160 0x7fb09000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb090004c50 msgr2=0x7fb090005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb090004c50 0x7fb090005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/2543646254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb090004160 msgr2=0x7fb09000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb090004160 0x7fb09000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a6d9d700 1 -- 172.21.15.189:0/2543646254 reap_dead start 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/2543646254 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090003570 con 0x7fb0900037b0 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a659c700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb090004c50 0x7fb090005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb090003c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c2d0 tx=0x7fb0a80ad780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29cc52b3a362708f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00cc00 con 0x7fb0900037b0 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00cd60 con 0x7fb0900037b0 2024-08-17T02:27:07.168 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a559a700 1 -- 172.21.15.189:0/2543646254 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c005b70 con 0x7fb0900037b0 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 msgr2=0x7fb090003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb090003c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c2d0 tx=0x7fb0a80ad780 comp rx=0 tx=0).stop 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- 172.21.15.189:0/2543646254 shutdown_connections 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 --2- 172.21.15.189:0/2543646254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb090003c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- 172.21.15.189:0/2543646254 >> 172.21.15.189:0/2543646254 conn(0x7fb0a806e310 msgr2=0x7fb0a806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- 172.21.15.189:0/2543646254 shutdown_connections 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- 172.21.15.189:0/2543646254 wait complete. 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 Processor -- start 2024-08-17T02:27:07.171 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.162+0000 7fb0a759e700 1 -- start start 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb0a814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a80a74a0 0x7fb0a80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80a99f0 con 0x7fb0a80a74a0 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80a8de0 con 0x7fb0900037b0 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80a90c0 con 0x7fb0a80a7030 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a659c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb0a814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58646/0 (socket says 172.21.15.189:58646) 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/3705235683 learned_addr learned my addr 172.21.15.189:0/3705235683 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a659c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb0a814b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36586/0 (socket says 172.21.15.189:36586) 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a6d9d700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a80a74a0 0x7fb0a80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 msgr2=0x7fb0a814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.172 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb0a814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/3705235683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a80a74a0 msgr2=0x7fb0a80ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a80a74a0 0x7fb0a80ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 -- 172.21.15.189:0/3705235683 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80a93a0 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a5d9b700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001ed0 tx=0x7fb09c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c001690 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0070d0 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c007490 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 -- 172.21.15.189:0/3705235683 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80a9680 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0a759e700 1 -- 172.21.15.189:0/3705235683 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80a8ba0 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb09c028460 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fb09c01e430 con 0x7fb0a80a7030 2024-08-17T02:27:07.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.166+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80638f0 con 0x7fb0a80a7030 2024-08-17T02:27:07.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.170+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb0a80a8ba0 con 0x7fb0a80a7030 2024-08-17T02:27:07.248 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.246+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad789d88-7793-43a5-88b9-9acfed2ca06d", "id": 5} v 0) v1 -- 0x7fb0a806aaf0 con 0x7fb0a80a7030 2024-08-17T02:27:07.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb0967fc700 1 -- 172.21.15.189:0/3705235683 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad789d88-7793-43a5-88b9-9acfed2ca06d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb09c017070 con 0x7fb0a80a7030 2024-08-17T02:27:07.256 INFO:teuthology.orchestra.run.smithi189.stdout:5 2024-08-17T02:27:07.256 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.253+0000 7f74ac785000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:07.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 msgr2=0x7fb0a80ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001ed0 tx=0x7fb09c015000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 shutdown_connections 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a80a74a0 0x7fb0a80ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0a80a7030 0x7fb0a80ab320 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 --2- 172.21.15.189:0/3705235683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0900037b0 0x7fb0a814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 >> 172.21.15.189:0/3705235683 conn(0x7fb0a806e310 msgr2=0x7fb0a815e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 shutdown_connections 2024-08-17T02:27:07.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.254+0000 7fb087fff700 1 -- 172.21.15.189:0/3705235683 wait complete. 2024-08-17T02:27:07.270 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new c9fd3af1-7e2f-40e2-b697-685927e6fe3f 6 2024-08-17T02:27:07.314 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.310+0000 7f8a232c6000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:07.316 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.313+0000 7f74ac785000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:07.367 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.362+0000 7f0c2359e700 1 Processor -- start 2024-08-17T02:27:07.367 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.362+0000 7f0c2359e700 1 -- start start 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240cf520 con 0x7f0c24066e00 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240d0f40 con 0x7f0c240cf9b0 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240ce690 con 0x7f0c241590a0 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:58650/0 (socket says 172.21.15.189:58650) 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 -- 172.21.15.189:0/822254211 learned_addr learned my addr 172.21.15.189:0/822254211 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:07.368 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c21d9b700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0c240cf9b0 0x7f0c240cb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39238/0 (socket says 172.21.15.189:39238) 2024-08-17T02:27:07.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2159a700 1 -- 172.21.15.189:0/822254211 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764600680 0 0) 0x7f0c240d0f40 con 0x7f0c240cf9b0 2024-08-17T02:27:07.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 -- 172.21.15.189:0/822254211 >> v1:172.21.15.189:6789/0 conn(0x7f0c240cf9b0 legacy=0x7f0c240cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 -- 172.21.15.189:0/822254211 >> v1:172.21.15.155:6789/0 conn(0x7f0c24066e00 legacy=0x7f0c240afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 -- 172.21.15.189:0/822254211 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240ce910 con 0x7f0c241590a0 2024-08-17T02:27:07.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2259c700 1 --2- 172.21.15.189:0/822254211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009f50 tx=0x7f0c14009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a99c703194a47dfa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2159a700 1 -- 172.21.15.189:0/822254211 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400e070 con 0x7f0c241590a0 2024-08-17T02:27:07.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2159a700 1 -- 172.21.15.189:0/822254211 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400bab0 con 0x7f0c241590a0 2024-08-17T02:27:07.370 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2159a700 1 -- 172.21.15.189:0/822254211 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140092e0 con 0x7f0c241590a0 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- 172.21.15.189:0/822254211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 msgr2=0x7f0c24159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 --2- 172.21.15.189:0/822254211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009f50 tx=0x7f0c14009840 comp rx=0 tx=0).stop 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- 172.21.15.189:0/822254211 shutdown_connections 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 --2- 172.21.15.189:0/822254211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c24159470 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- 172.21.15.189:0/822254211 >> 172.21.15.189:0/822254211 conn(0x7f0c24068c80 msgr2=0x7f0c240d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- 172.21.15.189:0/822254211 shutdown_connections 2024-08-17T02:27:07.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.366+0000 7f0c2359e700 1 -- 172.21.15.189:0/822254211 wait complete. 2024-08-17T02:27:07.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 Processor -- start 2024-08-17T02:27:07.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 -- start start 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 0x7f0c241527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c240b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2415aab0 con 0x7f0c240cf9b0 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240b5c10 con 0x7f0c24066e00 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2415bbe0 con 0x7f0c241590a0 2024-08-17T02:27:07.376 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36594/0 (socket says 172.21.15.189:36594) 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 -- 172.21.15.189:0/490549563 learned_addr learned my addr 172.21.15.189:0/490549563 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c22d9d700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c240b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c21d9b700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 0x7f0c241527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 -- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 msgr2=0x7f0c240b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c240b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 -- 172.21.15.189:0/490549563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 msgr2=0x7f0c241527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 0x7f0c241527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c2259c700 1 -- 172.21.15.189:0/490549563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14009ae0 con 0x7f0c24066e00 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.370+0000 7f0c21d9b700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 0x7f0c241527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c2259c700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009ab0 tx=0x7f0c14018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14007b20 con 0x7f0c24066e00 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14007ca0 con 0x7f0c24066e00 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140266b0 con 0x7f0c24066e00 2024-08-17T02:27:07.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c24159ea0 con 0x7f0c24066e00 2024-08-17T02:27:07.378 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2415a460 con 0x7f0c24066e00 2024-08-17T02:27:07.378 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f8a232c6000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:07.378 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0c14026cf0 con 0x7f0c24066e00 2024-08-17T02:27:07.378 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f0c1401dca0 con 0x7f0c24066e00 2024-08-17T02:27:07.379 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.374+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c24064330 con 0x7f0c24066e00 2024-08-17T02:27:07.379 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.373+0000 7f74ac785000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:07.381 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.378+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0c14021070 con 0x7f0c24066e00 2024-08-17T02:27:07.440 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.438+0000 7f8a232c6000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:07.456 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.454+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9fd3af1-7e2f-40e2-b697-685927e6fe3f", "id": 6} v 0) v1 -- 0x7f0c24067b80 con 0x7f0c24066e00 2024-08-17T02:27:07.463 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.458+0000 7f0c1a7fc700 1 -- 172.21.15.189:0/490549563 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9fd3af1-7e2f-40e2-b697-685927e6fe3f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c1401d6a0 con 0x7f0c24066e00 2024-08-17T02:27:07.463 INFO:teuthology.orchestra.run.smithi189.stdout:6 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 msgr2=0x7f0c2415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009ab0 tx=0x7f0c14018000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 shutdown_connections 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c241590a0 0x7f0c240b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cf9b0 0x7f0c241527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 --2- 172.21.15.189:0/490549563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c24066e00 0x7f0c2415b6a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 >> 172.21.15.189:0/490549563 conn(0x7f0c24068c80 msgr2=0x7f0c24156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 shutdown_connections 2024-08-17T02:27:07.465 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.462+0000 7f0c2359e700 1 -- 172.21.15.189:0/490549563 wait complete. 2024-08-17T02:27:07.475 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new c1934419-fccc-441a-b305-07333afa0584 7 2024-08-17T02:27:07.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 Processor -- start 2024-08-17T02:27:07.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 -- start start 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd460155890 0x7fd4600686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 0x7fd46006b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46006b000 con 0x7fd4601554c0 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.618+0000 7fd464a43700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd460069000 con 0x7fd460068be0 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46006a3f0 con 0x7fd460155890 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45e59c700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd4601554c0 0x7fd4600699a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:34432/0 (socket says 172.21.15.189:34432) 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45e59c700 1 -- 172.21.15.189:0/2148755767 learned_addr learned my addr 172.21.15.189:0/2148755767 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 --2- 172.21.15.189:0/2148755767 >> v2:172.21.15.189:3300/0 conn(0x7fd460155890 0x7fd4600686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45ed9d700 1 --2- 172.21.15.189:0/2148755767 >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 0x7fd46006b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45d59a700 1 -- 172.21.15.189:0/2148755767 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664967965 0 0) 0x7fd46006b000 con 0x7fd4601554c0 2024-08-17T02:27:07.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45d59a700 1 -- 172.21.15.189:0/2148755767 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd44c003570 con 0x7fd4601554c0 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 -- 172.21.15.189:0/2148755767 >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 msgr2=0x7fd46006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 --2- 172.21.15.189:0/2148755767 >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 0x7fd46006b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 -- 172.21.15.189:0/2148755767 >> v1:172.21.15.189:6789/0 conn(0x7fd4601554c0 legacy=0x7fd4600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 -- 172.21.15.189:0/2148755767 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46006a6d0 con 0x7fd460155890 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45ed9d700 1 --2- 172.21.15.189:0/2148755767 >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 0x7fd46006b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45dd9b700 1 --2- 172.21.15.189:0/2148755767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4600686a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd46006d120 tx=0x7fd4480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2caa79b425c7e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45d59a700 1 -- 172.21.15.189:0/2148755767 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448011630 con 0x7fd460155890 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45d59a700 1 -- 172.21.15.189:0/2148755767 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448011790 con 0x7fd460155890 2024-08-17T02:27:07.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd45d59a700 1 -- 172.21.15.189:0/2148755767 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448011b30 con 0x7fd460155890 2024-08-17T02:27:07.627 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- 172.21.15.189:0/2148755767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 msgr2=0x7fd4600686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.627 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 --2- 172.21.15.189:0/2148755767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4600686a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd46006d120 tx=0x7fd4480091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.627 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- 172.21.15.189:0/2148755767 shutdown_connections 2024-08-17T02:27:07.627 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 --2- 172.21.15.189:0/2148755767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4600686a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.627 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 --2- 172.21.15.189:0/2148755767 >> v2:172.21.15.155:3300/0 conn(0x7fd460068be0 0x7fd46006b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- 172.21.15.189:0/2148755767 >> 172.21.15.189:0/2148755767 conn(0x7fd4600c9bf0 msgr2=0x7fd46006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- 172.21.15.189:0/2148755767 shutdown_connections 2024-08-17T02:27:07.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- 172.21.15.189:0/2148755767 wait complete. 2024-08-17T02:27:07.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 Processor -- start 2024-08-17T02:27:07.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.622+0000 7fd464a43700 1 -- start start 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 0x7fd4601410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4601511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c74a0 con 0x7fd4601554c0 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c6890 con 0x7fd460155890 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c6b70 con 0x7fd460068be0 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45ed9d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4601511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:33002/0 (socket says 172.21.15.189:33002) 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 -- 172.21.15.189:0/281878931 learned_addr learned my addr 172.21.15.189:0/281878931 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45dd9b700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 0x7fd4601410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 -- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 msgr2=0x7fd4601511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4601511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 -- 172.21.15.189:0/281878931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 msgr2=0x7fd4601410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 0x7fd4601410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 -- 172.21.15.189:0/281878931 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009420 con 0x7fd460068be0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45dd9b700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 0x7fd4601410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd45e59c700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd45000c7c0 tx=0x7fd450007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450005b30 con 0x7fd460068be0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450005cb0 con 0x7fd460068be0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4600c6e50 con 0x7fd460068be0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450007320 con 0x7fd460068be0 2024-08-17T02:27:07.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd460141620 con 0x7fd460068be0 2024-08-17T02:27:07.632 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd450012400 con 0x7fd460068be0 2024-08-17T02:27:07.632 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd450005e20 con 0x7fd460068be0 2024-08-17T02:27:07.632 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.626+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4600713c0 con 0x7fd460068be0 2024-08-17T02:27:07.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.630+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd4600713c0 con 0x7fd460068be0 2024-08-17T02:27:07.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.706+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1934419-fccc-441a-b305-07333afa0584", "id": 7} v 0) v1 -- 0x7fd4600645c0 con 0x7fd460068be0 2024-08-17T02:27:07.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd4567fc700 1 -- 172.21.15.189:0/281878931 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1934419-fccc-441a-b305-07333afa0584", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd450021060 con 0x7fd460068be0 2024-08-17T02:27:07.718 INFO:teuthology.orchestra.run.smithi189.stdout:7 2024-08-17T02:27:07.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 msgr2=0x7fd46014f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd45000c7c0 tx=0x7fd450007e00 comp rx=0 tx=0).stop 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 shutdown_connections 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd460155890 0x7fd4601511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4601554c0 0x7fd4601410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 --2- 172.21.15.189:0/281878931 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd460068be0 0x7fd46014f4b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 >> 172.21.15.189:0/281878931 conn(0x7fd4600c9bf0 msgr2=0x7fd46006b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 shutdown_connections 2024-08-17T02:27:07.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-08-17T02:27:07.714+0000 7fd464a43700 1 -- 172.21.15.189:0/281878931 wait complete. 2024-08-17T02:27:07.732 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:27:07.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:27:07.735 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:27:07.735 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:27:07.735 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:27:07.737 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:27:07.738 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:27:07.738 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:27:07.740 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:27:07.740 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:27:07.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:27:07.743 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:27:07.743 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:27:07.743 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:27:07.745 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:27:07.745 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:27:07.745 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:27:07.749 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:27:07.749 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:27:07.749 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:27:07.751 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:27:07.752 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:27:07.752 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:27:07.754 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:27:07.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:07.792 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.789+0000 7f74ac785000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:07.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 Processor -- start 2024-08-17T02:27:07.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 -- start start 2024-08-17T02:27:07.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 0x7f5f680af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5f680ad0c0 0x7f5f6806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680afc70 con 0x7f5f6806d240 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6806dc00 con 0x7f5f681593d0 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6cad3700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680b11d0 con 0x7f5f680ad0c0 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 0x7f5f680af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 0x7f5f680af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54830/0 (socket says 172.21.15.155:54830) 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f6659c700 1 -- 172.21.15.155:0/1903770068 learned_addr learned my addr 172.21.15.155:0/1903770068 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:07.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.857+0000 7f5f66d9d700 1 --2- 172.21.15.155:0/1903770068 >> v2:172.21.15.189:3300/0 conn(0x7f5f680ad0c0 0x7f5f6806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f66d9d700 1 -- 172.21.15.155:0/1903770068 >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 msgr2=0x7f5f680af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f66d9d700 1 --2- 172.21.15.155:0/1903770068 >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 0x7f5f680af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f66d9d700 1 -- 172.21.15.155:0/1903770068 >> v1:172.21.15.189:6789/0 conn(0x7f5f6806d240 legacy=0x7f5f680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f66d9d700 1 -- 172.21.15.155:0/1903770068 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680b05c0 con 0x7f5f680ad0c0 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f66d9d700 1 --2- 172.21.15.155:0/1903770068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f680ad0c0 0x7f5f6806d6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f680c7f60 tx=0x7f5f580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcda68769a9a8a6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6559a700 1 -- 172.21.15.155:0/1903770068 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58011630 con 0x7f5f680ad0c0 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6559a700 1 -- 172.21.15.155:0/1903770068 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f58011790 con 0x7f5f680ad0c0 2024-08-17T02:27:07.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6559a700 1 -- 172.21.15.155:0/1903770068 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58011b30 con 0x7f5f680ad0c0 2024-08-17T02:27:07.864 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.858+0000 7f8a232c6000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 -- 172.21.15.155:0/1903770068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f680ad0c0 msgr2=0x7f5f6806d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/1903770068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f680ad0c0 0x7f5f6806d6c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f680c7f60 tx=0x7f5f580091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 -- 172.21.15.155:0/1903770068 shutdown_connections 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/1903770068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f680ad0c0 0x7f5f6806d6c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/1903770068 >> v2:172.21.15.155:3300/0 conn(0x7f5f681593d0 0x7f5f680af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 -- 172.21.15.155:0/1903770068 >> 172.21.15.155:0/1903770068 conn(0x7f5f680cc950 msgr2=0x7f5f68066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 -- 172.21.15.155:0/1903770068 shutdown_connections 2024-08-17T02:27:07.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.861+0000 7f5f6cad3700 1 -- 172.21.15.155:0/1903770068 wait complete. 2024-08-17T02:27:07.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 Processor -- start 2024-08-17T02:27:07.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- start start 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f6806d240 0x7f5f680c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f681593d0 0x7f5f68167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68167fd0 con 0x7f5f680ad0c0 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c9410 con 0x7f5f681593d0 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c8e70 con 0x7f5f6806d240 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6659c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f6806d240 0x7f5f680c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54832/0 (socket says 172.21.15.155:54832) 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 -- 172.21.15.155:0/2753762275 learned_addr learned my addr 172.21.15.155:0/2753762275 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f66d9d700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f681593d0 0x7f5f68167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 -- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f6806d240 msgr2=0x7f5f680c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f6806d240 0x7f5f680c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 -- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f681593d0 msgr2=0x7f5f68167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f681593d0 0x7f5f68167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 -- 172.21.15.155:0/2753762275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009420 con 0x7f5f680ad0c0 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f65d9b700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c5c0 tx=0x7f5f50007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50016070 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50006820 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50006bc0 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f68158580 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f680c9130 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5f50007000 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.865+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5f50011c70 con 0x7f5f680ad0c0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.869+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f680645c0 con 0x7f5f680ad0c0 2024-08-17T02:27:07.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.869+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5f50007490 con 0x7f5f680ad0c0 2024-08-17T02:27:07.914 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:07.913+0000 7f74ac785000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.933+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f68158b60 con 0x7f5f680ad0c0 2024-08-17T02:27:07.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f5e7fc700 1 -- 172.21.15.155:0/2753762275 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5f50007630 con 0x7f5f680ad0c0 2024-08-17T02:27:07.938 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:07.938 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":10,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:07.709880+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 msgr2=0x7f5f680cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c5c0 tx=0x7f5f50007f50 comp rx=0 tx=0).stop 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 shutdown_connections 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f681593d0 0x7f5f68167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680ad0c0 0x7f5f680cb8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 --2- 172.21.15.155:0/2753762275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f6806d240 0x7f5f680c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 >> 172.21.15.155:0/2753762275 conn(0x7f5f680cc950 msgr2=0x7f5f680a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 shutdown_connections 2024-08-17T02:27:07.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:07.937+0000 7f5f6cad3700 1 -- 172.21.15.155:0/2753762275 wait complete. 2024-08-17T02:27:07.950 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:27:07.950 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:27:07.976 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:07.974+0000 7f8a232c6000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:08.101 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-08-17T02:27:08.098+0000 7fe662df83c0 -1 Falling back to public interface 2024-08-17T02:27:08.108 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-08-17T02:27:08.105+0000 7f845521d3c0 -1 Falling back to public interface 2024-08-17T02:27:08.122 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-08-17T02:27:08.121+0000 7f70dab783c0 -1 Falling back to public interface 2024-08-17T02:27:08.124 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-08-17T02:27:08.121+0000 7fafb5e523c0 -1 Falling back to public interface 2024-08-17T02:27:08.129 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-08-17T02:27:08.126+0000 7f21be3513c0 -1 Falling back to public interface 2024-08-17T02:27:08.130 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-08-17T02:27:08.126+0000 7f59c40163c0 -1 Falling back to public interface 2024-08-17T02:27:08.130 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-08-17T02:27:08.126+0000 7f21bd31a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2024-08-17T02:27:08.213 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.209+0000 7f74ac785000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:08.296 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.294+0000 7f8a232c6000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:08.377 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-08-17T02:27:08.374+0000 7f8ef05163c0 -1 Falling back to public interface 2024-08-17T02:27:08.379 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.377+0000 7f74ac785000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:08.395 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-08-17T02:27:08.393+0000 7f5fa3e163c0 -1 Falling back to public interface 2024-08-17T02:27:08.447 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.445+0000 7f74ac785000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:08.461 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.458+0000 7f8a232c6000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:08.499 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.497+0000 7f74ac785000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:08.527 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.522+0000 7f8a232c6000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:08.556 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.553+0000 7f74ac785000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:08.579 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.574+0000 7f8a232c6000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:08.635 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.630+0000 7f8a232c6000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:08.725 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.721+0000 7f74ac785000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:08.755 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:08.793 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.790+0000 7f8a232c6000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:08.852 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 Processor -- start 2024-08-17T02:27:08.852 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 -- start start 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1d6806b840 0x7f1d681562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6806b3b0 con 0x7f1d680c9d90 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6815ab50 con 0x7f1d68155ef0 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6f034700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6806ab80 con 0x7f1d6806b840 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6d5d1700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1d680c9d90 0x7f1d68159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:59224/0 (socket says 172.21.15.155:59224) 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.849+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/1894565830 learned_addr learned my addr 172.21.15.155:0/1894565830 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 --2- 172.21.15.155:0/1894565830 >> v2:172.21.15.189:3300/0 conn(0x7f1d6806b840 0x7f1d681562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408205132 0 0) 0x7f1d6806b3b0 con 0x7f1d680c9d90 2024-08-17T02:27:08.854 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d58003570 con 0x7f1d680c9d90 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909316817 0 0) 0x7f1d58003570 con 0x7f1d680c9d90 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 >> v2:172.21.15.189:3300/0 conn(0x7f1d6806b840 msgr2=0x7f1d681562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 --2- 172.21.15.155:0/1894565830 >> v2:172.21.15.189:3300/0 conn(0x7f1d6806b840 0x7f1d681562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 >> v1:172.21.15.189:6789/0 conn(0x7f1d68155ef0 legacy=0x7f1d680c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6806ad60 con 0x7f1d680c9d90 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f1d600017f0 con 0x7f1d680c9d90 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 >> v1:172.21.15.155:6789/0 conn(0x7f1d680c9d90 legacy=0x7f1d68159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58003a60 0x7f1d58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 0x7f1d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d580051c0 0x7f1d5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6806ab80 con 0x7f1d58004810 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5800c160 con 0x7f1d580051c0 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5800c320 con 0x7f1d58003a60 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 0x7f1d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6cdd0700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58003a60 0x7f1d58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6d5d1700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d580051c0 0x7f1d5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 -- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58003a60 msgr2=0x7f1d58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58003a60 0x7f1d58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 -- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d580051c0 msgr2=0x7f1d5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d580051c0 0x7f1d5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 -- 172.21.15.155:0/1894565830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58003570 con 0x7f1d58004810 2024-08-17T02:27:08.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/1894565830 reap_dead start 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d67fff700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 0x7f1d58004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009c00 tx=0x7f1d540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356b9d0c02794390 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400e710 con 0x7f1d58004810 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5400e870 con 0x7f1d58004810 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d677fe700 1 -- 172.21.15.155:0/1894565830 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400ec30 con 0x7f1d58004810 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 -- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 msgr2=0x7f1d58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 0x7f1d58004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009c00 tx=0x7f1d540091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 -- 172.21.15.155:0/1894565830 shutdown_connections 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 --2- 172.21.15.155:0/1894565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d58004810 0x7f1d58004c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 -- 172.21.15.155:0/1894565830 >> 172.21.15.155:0/1894565830 conn(0x7f1d680ccfa0 msgr2=0x7f1d680cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 -- 172.21.15.155:0/1894565830 shutdown_connections 2024-08-17T02:27:08.859 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.853+0000 7f1d6f034700 1 -- 172.21.15.155:0/1894565830 wait complete. 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 Processor -- start 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- start start 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 0x7f1d6814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 0x7f1d681533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68151550 con 0x7f1d68151e50 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6814e060 con 0x7f1d681519e0 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68150940 con 0x7f1d58004810 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54846/0 (socket says 172.21.15.155:54846) 2024-08-17T02:27:08.862 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/2330432097 learned_addr learned my addr 172.21.15.155:0/2330432097 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6cdd0700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 0x7f1d6814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d67fff700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 0x7f1d681533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 msgr2=0x7f1d6814db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 0x7f1d6814db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 msgr2=0x7f1d681533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 0x7f1d681533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 -- 172.21.15.155:0/2330432097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68150c20 con 0x7f1d68151e50 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6cdd0700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 0x7f1d6814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d67fff700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 0x7f1d681533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6d5d1700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d6806a4b0 tx=0x7f1d60001300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000ec90 con 0x7f1d68151e50 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000ee30 con 0x7f1d68151e50 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68150f00 con 0x7f1d68151e50 2024-08-17T02:27:08.863 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60013670 con 0x7f1d68151e50 2024-08-17T02:27:08.864 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.857+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d681505f0 con 0x7f1d68151e50 2024-08-17T02:27:08.864 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.861+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1d60013c70 con 0x7f1d68151e50 2024-08-17T02:27:08.864 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.861+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1d6001d460 con 0x7f1d68151e50 2024-08-17T02:27:08.864 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.861+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68064c10 con 0x7f1d68151e50 2024-08-17T02:27:08.867 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.865+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1d6001d960 con 0x7f1d68151e50 2024-08-17T02:27:08.895 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.893+0000 7f74ac785000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:08.932 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.929+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d680caad0 con 0x7f1d68151e50 2024-08-17T02:27:08.933 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.929+0000 7f1d64ff9700 1 -- 172.21.15.155:0/2330432097 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f1d6001db00 con 0x7f1d68151e50 2024-08-17T02:27:08.933 INFO:teuthology.misc.health.smithi155.stdout: 2024-08-17T02:27:08.934 INFO:teuthology.misc.health.smithi155.stdout:{"epoch":10,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:07.709880+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 msgr2=0x7f1d68158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d6806a4b0 tx=0x7f1d60001300 comp rx=0 tx=0).stop 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 shutdown_connections 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d68151e50 0x7f1d68158650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d681519e0 0x7f1d681533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 --2- 172.21.15.155:0/2330432097 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1d58004810 0x7f1d6814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 >> 172.21.15.155:0/2330432097 conn(0x7f1d680ccfa0 msgr2=0x7f1d680cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 shutdown_connections 2024-08-17T02:27:08.935 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:08.933+0000 7f1d6f034700 1 -- 172.21.15.155:0/2330432097 wait complete. 2024-08-17T02:27:08.943 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:27:08.958 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:08.954+0000 7f8a232c6000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:08.961 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:08.957+0000 7f74ac785000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:09.022 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:09.018+0000 7f8a232c6000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:09.120 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:09.117+0000 7f74ac785000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:09.182 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:09.178+0000 7f8a232c6000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:09.188 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:09.185+0000 7f74ac785000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:09.250 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:09.246+0000 7f8a232c6000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:09.903 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:09.901+0000 7f74ac785000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:09.961 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-08-17T02:27:09.958+0000 7f8a232c6000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:10.945 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:10.941+0000 7f74957fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:27:10.948 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-08-17T02:27:10.945+0000 7f74957fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:27:11.613 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-08-17T02:27:11.610+0000 7fe662df83c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:27:11.742 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-08-17T02:27:11.741+0000 7f70dab783c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:27:11.748 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-08-17T02:27:11.746+0000 7f21be3513c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:27:11.761 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-08-17T02:27:11.757+0000 7fafb5e523c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:27:11.912 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-08-17T02:27:11.910+0000 7f59c40163c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:27:11.986 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-08-17T02:27:11.985+0000 7f845521d3c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:27:12.214 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-08-17T02:27:12.213+0000 7f5fa3e163c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:27:12.222 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-08-17T02:27:12.218+0000 7f8ef05163c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:27:14.617 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-08-17T02:27:14.613+0000 7f70d6318700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:27:14.637 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-08-17T02:27:14.633+0000 7fafb2e17700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:27:14.648 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-08-17T02:27:14.645+0000 7f70cf0bb700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:14.658 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-08-17T02:27:14.657+0000 7fafaa395700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:14.879 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-08-17T02:27:14.874+0000 7f21b9af1700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:27:14.887 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-08-17T02:27:14.882+0000 7f21b2894700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:14.900 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-08-17T02:27:14.898+0000 7f59c0fdb700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:27:14.906 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-08-17T02:27:14.902+0000 7f59b8559700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:14.929 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-08-17T02:27:14.926+0000 7fe65e598700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:27:14.937 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-08-17T02:27:14.934+0000 7fe65733b700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:15.309 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-08-17T02:27:15.306+0000 7f8eebcb6700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:27:15.319 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-08-17T02:27:15.318+0000 7f8ee4a59700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:15.558 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-08-17T02:27:15.553+0000 7f5f9f5b6700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:27:15.564 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-08-17T02:27:15.561+0000 7f5f98359700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:15.581 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-08-17T02:27:15.577+0000 7f84509bd700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:27:15.585 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-08-17T02:27:15.581+0000 7f8449760700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:15.751 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:15.856 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 Processor -- start 2024-08-17T02:27:15.856 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 -- start start 2024-08-17T02:27:15.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f04780cd290 0x7f0478163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cb120 con 0x7f0478153b30 2024-08-17T02:27:15.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cb3c0 con 0x7f0478153760 2024-08-17T02:27:15.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047f45f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780cb6a0 con 0x7f04780cd290 2024-08-17T02:27:15.857 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047dc5c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0478153b30 0x7f04780ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42282/0 (socket says 172.21.15.155:42282) 2024-08-17T02:27:15.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047dc5c700 1 -- 172.21.15.155:0/1427821817 learned_addr learned my addr 172.21.15.155:0/1427821817 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:15.858 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047ec5e700 1 --2- 172.21.15.155:0/1427821817 >> v2:172.21.15.189:3300/0 conn(0x7f04780cd290 0x7f0478163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.853+0000 7f047d45b700 1 -- 172.21.15.155:0/1427821817 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734607754 0 0) 0x7f04780cb120 con 0x7f0478153b30 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047d45b700 1 -- 172.21.15.155:0/1427821817 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0464003570 con 0x7f0478153b30 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047ec5e700 1 -- 172.21.15.155:0/1427821817 >> v1:172.21.15.189:6789/0 conn(0x7f0478153760 legacy=0x7f04780ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047ec5e700 1 -- 172.21.15.155:0/1427821817 >> v1:172.21.15.155:6789/0 conn(0x7f0478153b30 legacy=0x7f04780ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047ec5e700 1 -- 172.21.15.155:0/1427821817 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780cb980 con 0x7f04780cd290 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047ec5e700 1 --2- 172.21.15.155:0/1427821817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f0478163fb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e60 tx=0x7f0470009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb29adfb0e4d79f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047d45b700 1 -- 172.21.15.155:0/1427821817 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f04780cd290 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047d45b700 1 -- 172.21.15.155:0/1427821817 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000bb60 con 0x7f04780cd290 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047d45b700 1 -- 172.21.15.155:0/1427821817 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470012430 con 0x7f04780cd290 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- 172.21.15.155:0/1427821817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 msgr2=0x7f0478163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.860 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 --2- 172.21.15.155:0/1427821817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f0478163fb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e60 tx=0x7f0470009780 comp rx=0 tx=0).stop 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- 172.21.15.155:0/1427821817 shutdown_connections 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 --2- 172.21.15.155:0/1427821817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f0478163fb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- 172.21.15.155:0/1427821817 >> 172.21.15.155:0/1427821817 conn(0x7f0478063b90 msgr2=0x7f04780994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- 172.21.15.155:0/1427821817 shutdown_connections 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- 172.21.15.155:0/1427821817 wait complete. 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 Processor -- start 2024-08-17T02:27:15.861 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.857+0000 7f047f45f700 1 -- start start 2024-08-17T02:27:15.864 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f04780c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0478153b30 0x7f0478152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c8930 con 0x7f0478153760 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c9790 con 0x7f04780cd290 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c8b80 con 0x7f0478153b30 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047e45d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f04780c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41682/0 (socket says 172.21.15.155:41682) 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 -- 172.21.15.155:0/3778979011 learned_addr learned my addr 172.21.15.155:0/3778979011 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047ec5e700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0478153b30 0x7f0478152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.865 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 -- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0478153b30 msgr2=0x7f0478152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0478153b30 0x7f0478152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 -- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 msgr2=0x7f04780c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f04780c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 -- 172.21.15.155:0/3778979011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009a20 con 0x7f0478153760 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047dc5c700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c7f0 tx=0x7f046c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c005cd0 con 0x7f0478153760 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c005e50 con 0x7f0478153760 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04780c8e60 con 0x7f0478153760 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c007320 con 0x7f0478153760 2024-08-17T02:27:15.866 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.861+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780c9420 con 0x7f0478153760 2024-08-17T02:27:15.867 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478153010 con 0x7f0478153760 2024-08-17T02:27:15.867 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f046c01b3b0 con 0x7f0478153760 2024-08-17T02:27:15.868 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f046a7fc700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 0x7f045c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.868 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f046c07bc40 con 0x7f0478153760 2024-08-17T02:27:15.868 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f047e45d700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 0x7f045c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.868 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.865+0000 7f047e45d700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 0x7f045c062c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0474003aa0 tx=0x7f0474000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.873 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:15.869+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0478153010 con 0x7f0478153760 2024-08-17T02:27:16.042 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.037+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0478153010 con 0x7f0478153760 2024-08-17T02:27:16.043 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f046a7fc700 1 -- 172.21.15.155:0/3778979011 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f0478153010 con 0x7f0478153760 2024-08-17T02:27:16.043 INFO:teuthology.misc.health.smithi155.stdout: 2024-08-17T02:27:16.043 INFO:teuthology.misc.health.smithi155.stdout:{"epoch":14,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:15.661249+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:16.045 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 msgr2=0x7f045c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 0x7f045c062c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0474003aa0 tx=0x7f0474000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 msgr2=0x7f0478152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c7f0 tx=0x7f046c007e00 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 shutdown_connections 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f045c0607d0 0x7f045c062c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0478153b30 0x7f0478152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0478153760 0x7f0478152420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 --2- 172.21.15.155:0/3778979011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04780cd290 0x7f04780c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 >> 172.21.15.155:0/3778979011 conn(0x7f0478063b90 msgr2=0x7f04780ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 shutdown_connections 2024-08-17T02:27:16.046 INFO:teuthology.misc.health.smithi155.stderr:2024-08-17T02:27:16.041+0000 7f047f45f700 1 -- 172.21.15.155:0/3778979011 wait complete. 2024-08-17T02:27:16.056 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:27:16.056 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:27:16.056 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:16.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:16.059 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:16.059 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:16.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:16.061 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:16.061 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:16.061 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:16.064 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:16.065 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:16.065 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:16.067 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:16.068 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:27:16.068 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:16.130 INFO:tasks.ceph.mds.c.smithi155.stdout:starting mds.c at 2024-08-17T02:27:16.142 INFO:tasks.ceph.mds.a.smithi155.stdout:starting mds.a at 2024-08-17T02:27:16.143 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-08-17T02:27:16.160 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-08-17T02:27:16.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.165+0000 7fbd3f637700 1 Processor -- start 2024-08-17T02:27:16.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.165+0000 7fbd3f637700 1 -- start start 2024-08-17T02:27:16.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbd380a8f50 0x7fbd380a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3806e210 con 0x7fbd38159db0 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3806e4f0 con 0x7fbd380a8f50 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3806e7d0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbd380a8f50 0x7fbd380a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3dbd4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbd380a8f50 0x7fbd380a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:53382/0 (socket says 172.21.15.155:53382) 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/250864134 learned_addr learned my addr 172.21.15.155:0/250864134 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:16.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3dbd4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:57558/0 (socket says 172.21.15.155:57558) 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 msgr2=0x7fbd3806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/250864134 >> v1:172.21.15.189:6789/0 conn(0x7fbd38159db0 legacy=0x7fbd3815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/250864134 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3806eab0 con 0x7fbd380a8f50 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3dbd4700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3d3d3700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd380a9320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009f20 tx=0x7fbd30009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34765e83bc959745 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd2ffff700 1 -- 172.21.15.155:0/250864134 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000e070 con 0x7fbd380a8f50 2024-08-17T02:27:16.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd2ffff700 1 -- 172.21.15.155:0/250864134 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3000b9d0 con 0x7fbd380a8f50 2024-08-17T02:27:16.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd2ffff700 1 -- 172.21.15.155:0/250864134 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300092e0 con 0x7fbd380a8f50 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 msgr2=0x7fbd380a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd380a9320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009f20 tx=0x7fbd30009840 comp rx=0 tx=0).stop 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- 172.21.15.155:0/250864134 shutdown_connections 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd3806d4e0 0x7fbd3806d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 --2- 172.21.15.155:0/250864134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd380a9320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.169+0000 7fbd3f637700 1 -- 172.21.15.155:0/250864134 >> 172.21.15.155:0/250864134 conn(0x7fbd380cc950 msgr2=0x7fbd38066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- 172.21.15.155:0/250864134 shutdown_connections 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- 172.21.15.155:0/250864134 wait complete. 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 Processor -- start 2024-08-17T02:27:16.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- start start 2024-08-17T02:27:16.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd38144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 0x7fbd38154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380ae770 con 0x7fbd3806d4e0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38154250 con 0x7fbd380a8f50 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3f637700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380ab340 con 0x7fbd38159db0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41732/0 (socket says 172.21.15.155:41732) 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/91574440 learned_addr learned my addr 172.21.15.155:0/91574440 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3cbd2700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd38144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3dbd4700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 0x7fbd38154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 msgr2=0x7fbd38154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 0x7fbd38154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 msgr2=0x7fbd38144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd38144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3d3d3700 1 -- 172.21.15.155:0/91574440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34009420 con 0x7fbd3806d4e0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.173+0000 7fbd3dbd4700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 0x7fbd38154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd3d3d3700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b610 tx=0x7fbd30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300089a0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30008b00 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd30009ae0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30026460 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd380ae490 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3806ecd0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7fbd30003040 con 0x7fbd3806d4e0 2024-08-17T02:27:16.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 0x7fbd1c062cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd3cbd2700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 0x7fbd1c062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.177+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fbd3007e360 con 0x7fbd3806d4e0 2024-08-17T02:27:16.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.181+0000 7fbd3cbd2700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 0x7fbd1c062cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd380a9900 tx=0x7fbd28007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.185+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbd3806ecd0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.345+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd3806ecd0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.345+0000 7fbd2d7fa700 1 -- 172.21.15.155:0/91574440 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7fbd3806ecd0 con 0x7fbd3806d4e0 2024-08-17T02:27:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:16.350 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":14,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:15.661249+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 msgr2=0x7fbd1c062cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 0x7fbd1c062cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd380a9900 tx=0x7fbd28007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 msgr2=0x7fbd38156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b610 tx=0x7fbd30018000 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 shutdown_connections 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd1c060800 0x7fbd1c062cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd38159db0 0x7fbd38154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd380a8f50 0x7fbd38144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 --2- 172.21.15.155:0/91574440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3806d4e0 0x7fbd38156d00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 >> 172.21.15.155:0/91574440 conn(0x7fbd380cc950 msgr2=0x7fbd38069460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 shutdown_connections 2024-08-17T02:27:16.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.349+0000 7fbd3f637700 1 -- 172.21.15.155:0/91574440 wait complete. 2024-08-17T02:27:16.365 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:27:16.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:16.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 Processor -- start 2024-08-17T02:27:16.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- start start 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0900ace80 0x7fe090157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe090157890 0x7fe0900aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900adf50 con 0x7fe090156f80 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900ad340 con 0x7fe0900ace80 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900ad620 con 0x7fe090157890 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0900ace80 0x7fe090157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0900ace80 0x7fe090157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41742/0 (socket says 172.21.15.155:41742) 2024-08-17T02:27:16.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 -- 172.21.15.155:0/3419802193 learned_addr learned my addr 172.21.15.155:0/3419802193 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe095cc0700 1 --2- 172.21.15.155:0/3419802193 >> v2:172.21.15.189:3300/0 conn(0x7fe090157890 0x7fe0900aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 -- 172.21.15.155:0/3419802193 >> v2:172.21.15.189:3300/0 conn(0x7fe090157890 msgr2=0x7fe0900aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 --2- 172.21.15.155:0/3419802193 >> v2:172.21.15.189:3300/0 conn(0x7fe090157890 0x7fe0900aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 -- 172.21.15.155:0/3419802193 >> v1:172.21.15.189:6789/0 conn(0x7fe090156f80 legacy=0x7fe0900ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 -- 172.21.15.155:0/3419802193 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900ad900 con 0x7fe0900ace80 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe094cbe700 1 --2- 172.21.15.155:0/3419802193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0900ace80 0x7fe090157350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0840099b0 tx=0x7fe084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aa2b23d74542e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe083fff700 1 -- 172.21.15.155:0/3419802193 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084009ea0 con 0x7fe0900ace80 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe083fff700 1 -- 172.21.15.155:0/3419802193 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400b820 con 0x7fe0900ace80 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe083fff700 1 -- 172.21.15.155:0/3419802193 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400bbc0 con 0x7fe0900ace80 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- 172.21.15.155:0/3419802193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0900ace80 msgr2=0x7fe090157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 --2- 172.21.15.155:0/3419802193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0900ace80 0x7fe090157350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0840099b0 tx=0x7fe084009250 comp rx=0 tx=0).stop 2024-08-17T02:27:16.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- 172.21.15.155:0/3419802193 shutdown_connections 2024-08-17T02:27:16.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 --2- 172.21.15.155:0/3419802193 >> v2:172.21.15.189:3300/0 conn(0x7fe090157890 0x7fe0900aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 --2- 172.21.15.155:0/3419802193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0900ace80 0x7fe090157350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- 172.21.15.155:0/3419802193 >> 172.21.15.155:0/3419802193 conn(0x7fe090066e00 msgr2=0x7fe090067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- 172.21.15.155:0/3419802193 shutdown_connections 2024-08-17T02:27:16.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.469+0000 7fe097723700 1 -- 172.21.15.155:0/3419802193 wait complete. 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 Processor -- start 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- start start 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0900ace80 0x7fe0900aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 0x7fe0900979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900989d0 con 0x7fe090157890 2024-08-17T02:27:16.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09014c770 con 0x7fe0900ace80 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe090098410 con 0x7fe090156f80 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe094cbe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 0x7fe0900979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41758/0 (socket says 172.21.15.155:41758) 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 -- 172.21.15.155:0/802805765 learned_addr learned my addr 172.21.15.155:0/802805765 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe0954bf700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0900ace80 0x7fe0900aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 -- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 msgr2=0x7fe0900979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 0x7fe0900979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 -- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0900ace80 msgr2=0x7fe0900aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0900ace80 0x7fe0900aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 -- 172.21.15.155:0/802805765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840094f0 con 0x7fe090157890 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe094cbe700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 0x7fe0900979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe095cc0700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe088009ef0 tx=0x7fe08800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800cc00 con 0x7fe090157890 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0900986f0 con 0x7fe090157890 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800f040 con 0x7fe090157890 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe090098d20 con 0x7fe090157890 2024-08-17T02:27:16.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.473+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088014480 con 0x7fe090157890 2024-08-17T02:27:16.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09014c8e0 con 0x7fe090157890 2024-08-17T02:27:16.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7fe088014830 con 0x7fe090157890 2024-08-17T02:27:16.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe0817fa700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 0x7fe074062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fe08807d2c0 con 0x7fe090157890 2024-08-17T02:27:16.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe0954bf700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 0x7fe074062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.477+0000 7fe0954bf700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 0x7fe074062c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe08c003aa0 tx=0x7fe08c000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.485+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe08804dcc0 con 0x7fe090157890 2024-08-17T02:27:16.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.689+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0900645c0 con 0x7fe090157890 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.689+0000 7fe0817fa700 1 -- 172.21.15.155:0/802805765 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fe088018500 con 0x7fe090157890 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:16.692 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 msgr2=0x7fe074062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 0x7fe074062c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe08c003aa0 tx=0x7fe08c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 msgr2=0x7fe09014a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe088009ef0 tx=0x7fe08800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 shutdown_connections 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0740607d0 0x7fe074062c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe090157890 0x7fe09014a7c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe090156f80 0x7fe0900979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 --2- 172.21.15.155:0/802805765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0900ace80 0x7fe0900aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 >> 172.21.15.155:0/802805765 conn(0x7fe090066e00 msgr2=0x7fe09006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 shutdown_connections 2024-08-17T02:27:16.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:16.693+0000 7fe097723700 1 -- 172.21.15.155:0/802805765 wait complete. 2024-08-17T02:27:16.696 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 2 2024-08-17T02:27:18.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:18.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 Processor -- start 2024-08-17T02:27:18.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 -- start start 2024-08-17T02:27:18.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc078157060 0x7fc07806e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 0x7fc078160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0780c36f0 con 0x7fc07806a310 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780caec0 con 0x7fc078068db0 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc0803b1700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780ca2b0 con 0x7fc078157060 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07d94c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc07806a310 0x7fc0780686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42294/0 (socket says 172.21.15.155:42294) 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07d94c700 1 -- 172.21.15.155:0/1283949561 learned_addr learned my addr 172.21.15.155:0/1283949561 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e94e700 1 --2- 172.21.15.155:0/1283949561 >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 0x7fc078160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e14d700 1 --2- 172.21.15.155:0/1283949561 >> v2:172.21.15.189:3300/0 conn(0x7fc078157060 0x7fc07806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07d14b700 1 -- 172.21.15.155:0/1283949561 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132917185 0 0) 0x7fc0780c36f0 con 0x7fc07806a310 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07d14b700 1 -- 172.21.15.155:0/1283949561 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003570 con 0x7fc07806a310 2024-08-17T02:27:18.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e14d700 1 -- 172.21.15.155:0/1283949561 >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 msgr2=0x7fc078160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e14d700 1 --2- 172.21.15.155:0/1283949561 >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 0x7fc078160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e14d700 1 -- 172.21.15.155:0/1283949561 >> v1:172.21.15.155:6789/0 conn(0x7fc07806a310 legacy=0x7fc0780686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e14d700 1 -- 172.21.15.155:0/1283949561 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780ca590 con 0x7fc078157060 2024-08-17T02:27:18.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.812+0000 7fc07e94e700 1 --2- 172.21.15.155:0/1283949561 >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 0x7fc078160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:18.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc07e14d700 1 --2- 172.21.15.155:0/1283949561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc078157060 0x7fc07806e130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc07806d0e0 tx=0x7fc0740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5487f5be0239b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc07d14b700 1 -- 172.21.15.155:0/1283949561 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011630 con 0x7fc078157060 2024-08-17T02:27:18.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc07d14b700 1 -- 172.21.15.155:0/1283949561 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0740117b0 con 0x7fc078157060 2024-08-17T02:27:18.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc07d14b700 1 -- 172.21.15.155:0/1283949561 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011b70 con 0x7fc078157060 2024-08-17T02:27:18.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 -- 172.21.15.155:0/1283949561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc078157060 msgr2=0x7fc07806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 --2- 172.21.15.155:0/1283949561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc078157060 0x7fc07806e130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc07806d0e0 tx=0x7fc0740091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 -- 172.21.15.155:0/1283949561 shutdown_connections 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 --2- 172.21.15.155:0/1283949561 >> v2:172.21.15.155:3300/0 conn(0x7fc078068db0 0x7fc078160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 --2- 172.21.15.155:0/1283949561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc078157060 0x7fc07806e130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 -- 172.21.15.155:0/1283949561 >> 172.21.15.155:0/1283949561 conn(0x7fc0780c9c20 msgr2=0x7fc07806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 -- 172.21.15.155:0/1283949561 shutdown_connections 2024-08-17T02:27:18.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.816+0000 7fc0803b1700 1 -- 172.21.15.155:0/1283949561 wait complete. 2024-08-17T02:27:18.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 Processor -- start 2024-08-17T02:27:18.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- start start 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07806a310 0x7fc0780a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc078157060 0x7fc0780a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078159fa0 con 0x7fc078068db0 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0781590f0 con 0x7fc07806a310 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc078159390 con 0x7fc078157060 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41804/0 (socket says 172.21.15.155:41804) 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 -- 172.21.15.155:0/355458476 learned_addr learned my addr 172.21.15.155:0/355458476 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e94e700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc078157060 0x7fc0780a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07d94c700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07806a310 0x7fc0780a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 -- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc078157060 msgr2=0x7fc0780a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc078157060 0x7fc0780a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 -- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07806a310 msgr2=0x7fc0780a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07806a310 0x7fc0780a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 -- 172.21.15.155:0/355458476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070009a20 con 0x7fc078068db0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc07e14d700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc074013000 tx=0x7fc074017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011b30 con 0x7fc078068db0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074000cd0 con 0x7fc078068db0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc074009420 con 0x7fc078068db0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07401a660 con 0x7fc078068db0 2024-08-17T02:27:18.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.820+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc078159950 con 0x7fc078068db0 2024-08-17T02:27:18.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0780645c0 con 0x7fc078068db0 2024-08-17T02:27:18.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc07401a9d0 con 0x7fc078068db0 2024-08-17T02:27:18.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc06e7fc700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 0x7fc05c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc07407e330 con 0x7fc078068db0 2024-08-17T02:27:18.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc07d94c700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 0x7fc05c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.824+0000 7fc07d94c700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 0x7fc05c062d40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0780a6120 tx=0x7fc068009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:18.832+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc07404eb90 con 0x7fc078068db0 2024-08-17T02:27:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.036+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0780cc4c0 con 0x7fc078068db0 2024-08-17T02:27:19.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.100+0000 7fc06e7fc700 1 -- 172.21.15.155:0/355458476 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7fc074015de0 con 0x7fc078068db0 2024-08-17T02:27:19.104 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:19.104 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 msgr2=0x7fc05c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 0x7fc05c062d40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0780a6120 tx=0x7fc068009040 comp rx=0 tx=0).stop 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 msgr2=0x7fc078153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc074013000 tx=0x7fc074017000 comp rx=0 tx=0).stop 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 shutdown_connections 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc05c060890 0x7fc05c062d40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc078157060 0x7fc0780a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07806a310 0x7fc0780a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 --2- 172.21.15.155:0/355458476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc078068db0 0x7fc078153f30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 >> 172.21.15.155:0/355458476 conn(0x7fc0780c9c20 msgr2=0x7fc0780c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 shutdown_connections 2024-08-17T02:27:19.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.104+0000 7fc0803b1700 1 -- 172.21.15.155:0/355458476 wait complete. 2024-08-17T02:27:19.108 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 3 2024-08-17T02:27:19.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:19.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 Processor -- start 2024-08-17T02:27:19.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 -- start start 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb544068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb5440b0a70 0x7fb544155810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440b05e0 con 0x7fb544068840 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440af9d0 con 0x7fb5440b0a70 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54b540700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440afcb0 con 0x7fb5440af3f0 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.220+0000 7fb54a53e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb544068840 0x7fb5440ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42302/0 (socket says 172.21.15.155:42302) 2024-08-17T02:27:19.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 -- 172.21.15.155:0/2962319278 learned_addr learned my addr 172.21.15.155:0/2962319278 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:19.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb549d3d700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb544068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54ad3f700 1 --2- 172.21.15.155:0/2962319278 >> v2:172.21.15.189:3300/0 conn(0x7fb5440b0a70 0x7fb544155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694525409 0 0) 0x7fb5440b05e0 con 0x7fb544068840 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb530003570 con 0x7fb544068840 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097500405 0 0) 0x7fb530003570 con 0x7fb544068840 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 msgr2=0x7fb544068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb544068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 >> v2:172.21.15.189:3300/0 conn(0x7fb5440b0a70 msgr2=0x7fb544155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 --2- 172.21.15.155:0/2962319278 >> v2:172.21.15.189:3300/0 conn(0x7fb5440b0a70 0x7fb544155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440aff90 con 0x7fb544068840 2024-08-17T02:27:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fb540001470 con 0x7fb544068840 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 >> v1:172.21.15.155:6789/0 conn(0x7fb544068840 legacy=0x7fb5440ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb530003a60 0x7fb530003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb530004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530004d50 0x7fb5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440af9d0 con 0x7fb530003a60 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440afcb0 con 0x7fb530004d50 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000ba60 con 0x7fb5440af3f0 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb530003a60 0x7fb530003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54ad3f700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530004d50 0x7fb5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb549d3d700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb530004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 -- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 msgr2=0x7fb530004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb530004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 -- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530004d50 msgr2=0x7fb5300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530004d50 0x7fb5300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 -- 172.21.15.155:0/2962319278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530003570 con 0x7fb530003a60 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb549d3d700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb5440af3f0 0x7fb530004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54a53e700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb530003a60 0x7fb530003e70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c3c0 tx=0x7fb540001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe4c9714b38b845 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000cc30 con 0x7fb530003a60 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000cdb0 con 0x7fb530003a60 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54953c700 1 -- 172.21.15.155:0/2962319278 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540005b70 con 0x7fb530003a60 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 -- 172.21.15.155:0/2962319278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb530003a60 msgr2=0x7fb530003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 --2- 172.21.15.155:0/2962319278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb530003a60 0x7fb530003e70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c3c0 tx=0x7fb540001e90 comp rx=0 tx=0).stop 2024-08-17T02:27:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54ad3f700 1 -- 172.21.15.155:0/2962319278 reap_dead start 2024-08-17T02:27:19.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 -- 172.21.15.155:0/2962319278 shutdown_connections 2024-08-17T02:27:19.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 -- 172.21.15.155:0/2962319278 >> 172.21.15.155:0/2962319278 conn(0x7fb54406d800 msgr2=0x7fb54406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 -- 172.21.15.155:0/2962319278 shutdown_connections 2024-08-17T02:27:19.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.224+0000 7fb54b540700 1 -- 172.21.15.155:0/2962319278 wait complete. 2024-08-17T02:27:19.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 Processor -- start 2024-08-17T02:27:19.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 -- start start 2024-08-17T02:27:19.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530003a60 0x7fb544157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb544140a80 0x7fb5441412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544156e40 con 0x7fb5441584c0 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544156010 con 0x7fb530003a60 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb544157980 con 0x7fb544140a80 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41836/0 (socket says 172.21.15.155:41836) 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 -- 172.21.15.155:0/1974125231 learned_addr learned my addr 172.21.15.155:0/1974125231 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54a53e700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530003a60 0x7fb544157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54ad3f700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb544140a80 0x7fb5441412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 -- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb544140a80 msgr2=0x7fb5441412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb544140a80 0x7fb5441412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 -- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530003a60 msgr2=0x7fb544157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530003a60 0x7fb544157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 -- 172.21.15.155:0/1974125231 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544157050 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb549d3d700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb534010ca0 tx=0x7fb534008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400e8c0 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400ea20 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb544157330 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.228+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400ede0 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb544140ef0 con 0x7fb5441584c0 2024-08-17T02:27:19.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb544157b30 con 0x7fb5441584c0 2024-08-17T02:27:19.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb53401c610 con 0x7fb5441584c0 2024-08-17T02:27:19.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb53a7fc700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 0x7fb528062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb54a53e700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 0x7fb528062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.232+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb53407ccd0 con 0x7fb5441584c0 2024-08-17T02:27:19.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.236+0000 7fb54a53e700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 0x7fb528062d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb540001ed0 tx=0x7fb540015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.240+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb544157b30 con 0x7fb5441584c0 2024-08-17T02:27:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.408+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb544157b30 con 0x7fb5441584c0 2024-08-17T02:27:19.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.408+0000 7fb53a7fc700 1 -- 172.21.15.155:0/1974125231 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fb544157b30 con 0x7fb5441584c0 2024-08-17T02:27:19.413 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:19.413 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":17,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:18.669668+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 msgr2=0x7fb528062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 0x7fb528062d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb540001ed0 tx=0x7fb540015000 comp rx=0 tx=0).stop 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 msgr2=0x7fb544155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb534010ca0 tx=0x7fb534008040 comp rx=0 tx=0).stop 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 shutdown_connections 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb528060890 0x7fb528062d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb544140a80 0x7fb5441412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5441584c0 0x7fb544155ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 --2- 172.21.15.155:0/1974125231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb530003a60 0x7fb544157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 >> 172.21.15.155:0/1974125231 conn(0x7fb54406d800 msgr2=0x7fb5440ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 shutdown_connections 2024-08-17T02:27:19.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.412+0000 7fb54b540700 1 -- 172.21.15.155:0/1974125231 wait complete. 2024-08-17T02:27:19.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:19.427 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:19.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 Processor -- start 2024-08-17T02:27:19.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 -- start start 2024-08-17T02:27:19.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff114168580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1140b0010 con 0x7ff11406ec50 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1140af440 con 0x7ff114146f40 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11abb1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140af6e0 con 0x7ff11415dcc0 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff113fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff11406ec50 0x7ff1140a8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42316/0 (socket says 172.21.15.155:42316) 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff113fff700 1 -- 172.21.15.155:0/2539899032 learned_addr learned my addr 172.21.15.155:0/2539899032 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11914e700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff114168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263980151 0 0) 0x7ff1140b0010 con 0x7ff11406ec50 2024-08-17T02:27:19.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff100003570 con 0x7ff11406ec50 2024-08-17T02:27:19.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3487308597 0 0) 0x7ff100003570 con 0x7ff11406ec50 2024-08-17T02:27:19.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 msgr2=0x7ff114168580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff114168580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 >> v1:172.21.15.189:6789/0 conn(0x7ff114146f40 legacy=0x7ff11406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140af9c0 con 0x7ff11406ec50 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7ff104001470 con 0x7ff11406ec50 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 >> v1:172.21.15.155:6789/0 conn(0x7ff11406ec50 legacy=0x7ff1140a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff100003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004010 0x7ff100004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff100004d50 0x7ff1000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140af6e0 con 0x7ff100004d50 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10000bbf0 con 0x7ff100004010 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10000bdb0 con 0x7ff11415dcc0 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11914e700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff100004d50 0x7ff1000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff11894d700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff100003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.532+0000 7ff113fff700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004010 0x7ff100004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 -- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 msgr2=0x7ff100003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff11415dcc0 0x7ff100003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 -- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004010 msgr2=0x7ff100004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004010 0x7ff100004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 -- 172.21.15.155:0/2539899032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100003570 con 0x7ff100004d50 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff113fff700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004010 0x7ff100004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff100004d50 0x7ff1000051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0094d0 tx=0x7ff10c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa8feda0f4592ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00ea90 con 0x7ff100004d50 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00f040 con 0x7ff100004d50 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff1137fe700 1 -- 172.21.15.155:0/2539899032 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00ee20 con 0x7ff100004d50 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- 172.21.15.155:0/2539899032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff100004d50 msgr2=0x7ff1000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 --2- 172.21.15.155:0/2539899032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff100004d50 0x7ff1000051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0094d0 tx=0x7ff10c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11914e700 1 -- 172.21.15.155:0/2539899032 reap_dead start 2024-08-17T02:27:19.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- 172.21.15.155:0/2539899032 shutdown_connections 2024-08-17T02:27:19.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- 172.21.15.155:0/2539899032 >> 172.21.15.155:0/2539899032 conn(0x7ff114066e00 msgr2=0x7ff114067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- 172.21.15.155:0/2539899032 shutdown_connections 2024-08-17T02:27:19.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- 172.21.15.155:0/2539899032 wait complete. 2024-08-17T02:27:19.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 Processor -- start 2024-08-17T02:27:19.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.536+0000 7ff11abb1700 1 -- start start 2024-08-17T02:27:19.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004d50 0x7ff1140999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff114142e80 0x7ff1140cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140ad8b0 con 0x7ff114142a10 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114099f20 con 0x7ff100004d50 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140acca0 con 0x7ff114142e80 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41868/0 (socket says 172.21.15.155:41868) 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 -- 172.21.15.155:0/4044959566 learned_addr learned my addr 172.21.15.155:0/4044959566 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11894d700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004d50 0x7ff1140999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11914e700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff114142e80 0x7ff1140cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 -- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff114142e80 msgr2=0x7ff1140cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff114142e80 0x7ff1140cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 -- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004d50 msgr2=0x7ff1140999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004d50 0x7ff1140999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 -- 172.21.15.155:0/4044959566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140acf80 con 0x7ff114142a10 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff113fff700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff104000fd0 tx=0x7ff104000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004a40 con 0x7ff114142a10 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104010040 con 0x7ff114142a10 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1140ad260 con 0x7ff114142a10 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004df0 con 0x7ff114142a10 2024-08-17T02:27:19.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.540+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1140ac590 con 0x7ff114142a10 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff104005260 con 0x7ff114142a10 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1140645c0 con 0x7ff114142a10 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff110ff9700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 0x7ff0f4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff10407be60 con 0x7ff114142a10 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff11894d700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 0x7ff0f4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.544+0000 7ff11894d700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 0x7ff0f4062d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007fd0 tx=0x7ff0fc00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.552+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff10404c560 con 0x7ff114142a10 2024-08-17T02:27:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1140cb690 con 0x7ff114142a10 2024-08-17T02:27:19.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff110ff9700 1 -- 172.21.15.155:0/4044959566 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff10401a020 con 0x7ff114142a10 2024-08-17T02:27:19.719 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:19.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 msgr2=0x7ff0f4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 0x7ff0f4062d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007fd0 tx=0x7ff0fc00c040 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 msgr2=0x7ff1140ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff104000fd0 tx=0x7ff104000c30 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 shutdown_connections 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff0f4060860 0x7ff0f4062d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff114142e80 0x7ff1140cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff114142a10 0x7ff1140ca720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 --2- 172.21.15.155:0/4044959566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff100004d50 0x7ff1140999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 >> 172.21.15.155:0/4044959566 conn(0x7ff114066e00 msgr2=0x7ff1141437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 shutdown_connections 2024-08-17T02:27:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.716+0000 7ff11abb1700 1 -- 172.21.15.155:0/4044959566 wait complete. 2024-08-17T02:27:19.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:19.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 Processor -- start 2024-08-17T02:27:19.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 -- start start 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2564153320 0x7f25641536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 0x7f256415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256415dbd0 con 0x7f256415a190 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640ce430 con 0x7f2564153320 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2563fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256415d370 con 0x7f25640cd1b0 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2562ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2564153320 0x7f25641536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f25627fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f256415a190 0x7f25640ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42318/0 (socket says 172.21.15.155:42318) 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f25627fc700 1 -- 172.21.15.155:0/3876220667 learned_addr learned my addr 172.21.15.155:0/3876220667 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f25637fe700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 0x7f256415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2561ffb700 1 -- 172.21.15.155:0/3876220667 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678336580 0 0) 0x7f256415dbd0 con 0x7f256415a190 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2561ffb700 1 -- 172.21.15.155:0/3876220667 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2550003570 con 0x7f256415a190 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2562ffd700 1 -- 172.21.15.155:0/3876220667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 msgr2=0x7f256415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 0x7f256415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2562ffd700 1 -- 172.21.15.155:0/3876220667 >> v1:172.21.15.155:6789/0 conn(0x7f256415a190 legacy=0x7f25640ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f2562ffd700 1 -- 172.21.15.155:0/3876220667 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256415a590 con 0x7f2564153320 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.836+0000 7f25637fe700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 0x7f256415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2564153320 0x7f25641536f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25540098e0 tx=0x7f25540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e0615818c7e59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2561ffb700 1 -- 172.21.15.155:0/3876220667 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554011630 con 0x7f2564153320 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2561ffb700 1 -- 172.21.15.155:0/3876220667 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554011790 con 0x7f2564153320 2024-08-17T02:27:19.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2561ffb700 1 -- 172.21.15.155:0/3876220667 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554011b30 con 0x7f2564153320 2024-08-17T02:27:19.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 -- 172.21.15.155:0/3876220667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2564153320 msgr2=0x7f25641536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2564153320 0x7f25641536f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25540098e0 tx=0x7f25540091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 -- 172.21.15.155:0/3876220667 shutdown_connections 2024-08-17T02:27:19.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25640cd1b0 0x7f256415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 --2- 172.21.15.155:0/3876220667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2564153320 0x7f25641536f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 -- 172.21.15.155:0/3876220667 >> 172.21.15.155:0/3876220667 conn(0x7f25640d00a0 msgr2=0x7f25640d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:19.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 -- 172.21.15.155:0/3876220667 shutdown_connections 2024-08-17T02:27:19.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.840+0000 7f2563fff700 1 -- 172.21.15.155:0/3876220667 wait complete. 2024-08-17T02:27:19.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 Processor -- start 2024-08-17T02:27:19.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- start start 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 0x7f2564154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2564153320 0x7f25640b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640b5cf0 con 0x7f256415a190 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640afc60 con 0x7f25640cd1b0 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640afeb0 con 0x7f2564153320 2024-08-17T02:27:19.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41884/0 (socket says 172.21.15.155:41884) 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 -- 172.21.15.155:0/3074183793 learned_addr learned my addr 172.21.15.155:0/3074183793 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25627fc700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2564153320 0x7f25640b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 0x7f2564154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 -- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2564153320 msgr2=0x7f25640b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2564153320 0x7f25640b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 -- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 msgr2=0x7f2564154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 0x7f2564154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 -- 172.21.15.155:0/3074183793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c009a20 con 0x7f256415a190 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 0x7f2564154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f25637fe700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f255c00ef90 tx=0x7f255c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00cd30 con 0x7f256415a190 2024-08-17T02:27:19.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00f040 con 0x7f256415a190 2024-08-17T02:27:19.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554009420 con 0x7f256415a190 2024-08-17T02:27:19.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0146b0 con 0x7f256415a190 2024-08-17T02:27:19.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.844+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25640b0470 con 0x7f256415a190 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25640638f0 con 0x7f256415a190 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f255c014ae0 con 0x7f256415a190 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f255affd700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 0x7f2544062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f255c07d7a0 con 0x7f256415a190 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 0x7f2544062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.848+0000 7f2562ffd700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 0x7f2544062d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25540091e0 tx=0x7f2554017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:19.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:19.856+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f255c04dea0 con 0x7f256415a190 2024-08-17T02:27:20.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.020+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25640cde20 con 0x7f256415a190 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f255affd700 1 -- 172.21.15.155:0/3074183793 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f255c018090 con 0x7f256415a190 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout: "poolnum": 1, 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout: "poolname": ".mgr" 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:27:20.026 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-08-17T02:27:20.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 msgr2=0x7f2544062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 0x7f2544062d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25540091e0 tx=0x7f2554017000 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 msgr2=0x7f2564156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f255c00ef90 tx=0x7f255c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 shutdown_connections 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2544060860 0x7f2544062d10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f256415a190 0x7f2564156480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2564153320 0x7f25640b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 --2- 172.21.15.155:0/3074183793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25640cd1b0 0x7f2564154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 >> 172.21.15.155:0/3074183793 conn(0x7f25640d00a0 msgr2=0x7f2564152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 shutdown_connections 2024-08-17T02:27:20.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.024+0000 7f2563fff700 1 -- 172.21.15.155:0/3074183793 wait complete. 2024-08-17T02:27:20.040 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:20.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:20.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.144+0000 7fc014f9d700 1 Processor -- start 2024-08-17T02:27:20.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 -- start start 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0100cbb70 0x7fc0100b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbf40 0x7fc0100686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0100b1680 con 0x7fc0100af540 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0100b0710 con 0x7fc0100cbb70 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc014f9d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100afb00 con 0x7fc0100cbf40 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0100cbb70 0x7fc0100b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0100cbb70 0x7fc0100b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41888/0 (socket says 172.21.15.155:41888) 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 -- 172.21.15.155:0/4190582377 learned_addr learned my addr 172.21.15.155:0/4190582377 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:20.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00effd700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbf40 0x7fc0100686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 -- 172.21.15.155:0/4190582377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbf40 msgr2=0x7fc0100686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbf40 0x7fc0100686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00e7fc700 1 -- 172.21.15.155:0/4190582377 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186023251 0 0) 0x7fc008001110 con 0x7fc0100af540 2024-08-17T02:27:20.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 -- 172.21.15.155:0/4190582377 >> v1:172.21.15.189:6789/0 conn(0x7fc0100af540 legacy=0x7fc01015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 -- 172.21.15.155:0/4190582377 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100afde0 con 0x7fc0100cbb70 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00f7fe700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100cbb70 0x7fc0100b1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc000009f20 tx=0x7fc000009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367f88e303ec831 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00e7fc700 1 -- 172.21.15.155:0/4190582377 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000e070 con 0x7fc0100cbb70 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00e7fc700 1 -- 172.21.15.155:0/4190582377 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000ba60 con 0x7fc0100cbb70 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.148+0000 7fc00e7fc700 1 -- 172.21.15.155:0/4190582377 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000092e0 con 0x7fc0100cbb70 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- 172.21.15.155:0/4190582377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100cbb70 msgr2=0x7fc0100b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100cbb70 0x7fc0100b1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc000009f20 tx=0x7fc000009840 comp rx=0 tx=0).stop 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- 172.21.15.155:0/4190582377 shutdown_connections 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbf40 0x7fc0100686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 --2- 172.21.15.155:0/4190582377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100cbb70 0x7fc0100b1140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- 172.21.15.155:0/4190582377 >> 172.21.15.155:0/4190582377 conn(0x7fc0100ccfe0 msgr2=0x7fc01006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- 172.21.15.155:0/4190582377 shutdown_connections 2024-08-17T02:27:20.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- 172.21.15.155:0/4190582377 wait complete. 2024-08-17T02:27:20.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 Processor -- start 2024-08-17T02:27:20.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.152+0000 7fc014f9d700 1 -- start start 2024-08-17T02:27:20.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbb70 0x7fc0100a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0100cbf40 0x7fc010142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010146180 con 0x7fc0100af540 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100a6ff0 con 0x7fc0100cbf40 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100a72d0 con 0x7fc0100cbb70 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41904/0 (socket says 172.21.15.155:41904) 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 -- 172.21.15.155:0/1817318042 learned_addr learned my addr 172.21.15.155:0/1817318042 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00effd700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbb70 0x7fc0100a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00ffff700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0100cbf40 0x7fc010142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 -- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbb70 msgr2=0x7fc0100a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbb70 0x7fc0100a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 -- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0100cbf40 msgr2=0x7fc010142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0100cbf40 0x7fc010142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 -- 172.21.15.155:0/1817318042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000009ae0 con 0x7fc0100af540 2024-08-17T02:27:20.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc00f7fe700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc01006d100 tx=0x7fc000018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000008a00 con 0x7fc0100af540 2024-08-17T02:27:20.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000008b80 con 0x7fc0100af540 2024-08-17T02:27:20.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0100a75b0 con 0x7fc0100af540 2024-08-17T02:27:20.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00001d420 con 0x7fc0100af540 2024-08-17T02:27:20.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.156+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0100a7b70 con 0x7fc0100af540 2024-08-17T02:27:20.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0100a7d60 con 0x7fc0100af540 2024-08-17T02:27:20.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc000003040 con 0x7fc0100af540 2024-08-17T02:27:20.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc0077fe700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 0x7fbff0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc00effd700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 0x7fbff0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc00007e220 con 0x7fc0100af540 2024-08-17T02:27:20.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.160+0000 7fc00effd700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 0x7fbff0062d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc01006ded0 tx=0x7fbff80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.168+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc00004e920 con 0x7fc0100af540 2024-08-17T02:27:20.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.328+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0100644b0 con 0x7fc0100af540 2024-08-17T02:27:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.656+0000 7fc0077fe700 1 -- 172.21.15.155:0/1817318042 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc000051f40 con 0x7fc0100af540 2024-08-17T02:27:20.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 msgr2=0x7fbff0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 0x7fbff0062d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc01006ded0 tx=0x7fbff80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 msgr2=0x7fc0100ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc01006d100 tx=0x7fc000018000 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 shutdown_connections 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbff0060860 0x7fbff0062d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0100cbf40 0x7fc010142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc0100cbb70 0x7fc0100a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 --2- 172.21.15.155:0/1817318042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0100af540 0x7fc0100ab1b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 >> 172.21.15.155:0/1817318042 conn(0x7fc0100ccfe0 msgr2=0x7fc0100ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 shutdown_connections 2024-08-17T02:27:20.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.664+0000 7fc014f9d700 1 -- 172.21.15.155:0/1817318042 wait complete. 2024-08-17T02:27:20.669 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:20.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:20.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 Processor -- start 2024-08-17T02:27:20.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 -- start start 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 0x7fbf480cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480cbeb0 0x7fbf480b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf480b3420 0x7fbf480b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cc320 con 0x7fbf480b3420 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480b3de0 con 0x7fbf48140bc0 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4e0f7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480af580 con 0x7fbf480cbeb0 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4d8f6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf480b3420 0x7fbf480b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4d8f6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf480b3420 0x7fbf480b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41908/0 (socket says 172.21.15.155:41908) 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/4064261532 learned_addr learned my addr 172.21.15.155:0/4064261532 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4d0f5700 1 --2- 172.21.15.155:0/4064261532 >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 0x7fbf480cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.796+0000 7fbf4c8f4700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480cbeb0 0x7fbf480b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/4064261532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480cbeb0 msgr2=0x7fbf480b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480cbeb0 0x7fbf480b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/4064261532 >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 msgr2=0x7fbf480cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/4064261532 >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 0x7fbf480cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/4064261532 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480b1480 con 0x7fbf480b3420 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d0f5700 1 --2- 172.21.15.155:0/4064261532 >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 0x7fbf480cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf480b3420 0x7fbf480b38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf480703d0 tx=0x7fbf40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81648d3bdb5895f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf3ffff700 1 -- 172.21.15.155:0/4064261532 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000b860 con 0x7fbf480b3420 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf3ffff700 1 -- 172.21.15.155:0/4064261532 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000b9c0 con 0x7fbf480b3420 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf3ffff700 1 -- 172.21.15.155:0/4064261532 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000bd60 con 0x7fbf480b3420 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/4064261532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf480b3420 msgr2=0x7fbf480b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf480b3420 0x7fbf480b38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf480703d0 tx=0x7fbf40009250 comp rx=0 tx=0).stop 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/4064261532 shutdown_connections 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf480b3420 0x7fbf480b38a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/4064261532 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480cbeb0 0x7fbf480b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/4064261532 >> v2:172.21.15.189:3300/0 conn(0x7fbf48140bc0 0x7fbf480cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/4064261532 >> 172.21.15.155:0/4064261532 conn(0x7fbf480ce120 msgr2=0x7fbf480ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/4064261532 shutdown_connections 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.800+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/4064261532 wait complete. 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 Processor -- start 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- start start 2024-08-17T02:27:20.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480b3420 0x7fbf480c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf480cbeb0 0x7fbf480c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c63c0 con 0x7fbf48140bc0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4815c060 con 0x7fbf480cbeb0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c7d90 con 0x7fbf480b3420 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41912/0 (socket says 172.21.15.155:41912) 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/2372804897 learned_addr learned my addr 172.21.15.155:0/2372804897 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d0f5700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480b3420 0x7fbf480c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4c8f4700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf480cbeb0 0x7fbf480c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480b3420 msgr2=0x7fbf480c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480b3420 0x7fbf480c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf480cbeb0 msgr2=0x7fbf480c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf480cbeb0 0x7fbf480c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 -- 172.21.15.155:0/2372804897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094f0 con 0x7fbf48140bc0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4d8f6700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbf400090b0 tx=0x7fbf40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4001a710 con 0x7fbf48140bc0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4001f070 con 0x7fbf48140bc0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480c8070 con 0x7fbf48140bc0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4001aac0 con 0x7fbf48140bc0 2024-08-17T02:27:20.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.804+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf480c7a30 con 0x7fbf48140bc0 2024-08-17T02:27:20.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf480c8550 con 0x7fbf48140bc0 2024-08-17T02:27:20.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbf4001b430 con 0x7fbf48140bc0 2024-08-17T02:27:20.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf3d7fa700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 0x7fbf2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf4d0f5700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 0x7fbf2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fbf40021070 con 0x7fbf48140bc0 2024-08-17T02:27:20.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.808+0000 7fbf4d0f5700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 0x7fbf2c062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf38006f00 tx=0x7fbf38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.816+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbf4004f380 con 0x7fbf48140bc0 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:20.980+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbf480638f0 con 0x7fbf48140bc0 2024-08-17T02:27:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.660+0000 7fbf3d7fa700 1 -- 172.21.15.155:0/2372804897 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbf40015020 con 0x7fbf48140bc0 2024-08-17T02:27:21.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 msgr2=0x7fbf2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 0x7fbf2c062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf38006f00 tx=0x7fbf38008040 comp rx=0 tx=0).stop 2024-08-17T02:27:21.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 msgr2=0x7fbf480c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbf400090b0 tx=0x7fbf40017000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 shutdown_connections 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbf2c060860 0x7fbf2c062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.672+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf48140bc0 0x7fbf480c8870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.676+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf480cbeb0 0x7fbf480c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.676+0000 7fbf4e0f7700 1 --2- 172.21.15.155:0/2372804897 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbf480b3420 0x7fbf480c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.676+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 >> 172.21.15.155:0/2372804897 conn(0x7fbf480ce120 msgr2=0x7fbf4806b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.676+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 shutdown_connections 2024-08-17T02:27:21.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.676+0000 7fbf4e0f7700 1 -- 172.21.15.155:0/2372804897 wait complete. 2024-08-17T02:27:21.688 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' created 2024-08-17T02:27:21.698 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 Processor -- start 2024-08-17T02:27:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 -- start start 2024-08-17T02:27:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00cd150 con 0x7f9ec00b2210 2024-08-17T02:27:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0159ce0 con 0x7f9ec00b5750 2024-08-17T02:27:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec82ce700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00af570 con 0x7f9ec00cc840 2024-08-17T02:27:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec5869700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9ec00b2210 0x7f9ec00b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42324/0 (socket says 172.21.15.155:42324) 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.800+0000 7f9ec5869700 1 -- 172.21.15.155:0/46108828 learned_addr learned my addr 172.21.15.155:0/46108828 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec606a700 1 --2- 172.21.15.155:0/46108828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291848487 0 0) 0x7f9ec00cd150 con 0x7f9ec00b2210 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea8003570 con 0x7f9ec00b2210 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6341089 0 0) 0x7f9ec0159ce0 con 0x7f9ec00b5750 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec00cd150 con 0x7f9ec00b5750 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec606a700 1 -- 172.21.15.155:0/46108828 >> v1:172.21.15.189:6789/0 conn(0x7f9ec00b5750 legacy=0x7f9ec015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec606a700 1 -- 172.21.15.155:0/46108828 >> v1:172.21.15.155:6789/0 conn(0x7f9ec00b2210 legacy=0x7f9ec00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec606a700 1 -- 172.21.15.155:0/46108828 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0159fc0 con 0x7f9ec00cc840 2024-08-17T02:27:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec606a700 1 --2- 172.21.15.155:0/46108828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00ccc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009910 tx=0x7f9eb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9f79307f20b1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0011630 con 0x7f9ec00cc840 2024-08-17T02:27:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0011790 con 0x7f9ec00cc840 2024-08-17T02:27:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec5068700 1 -- 172.21.15.155:0/46108828 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0011b30 con 0x7f9ec00cc840 2024-08-17T02:27:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- 172.21.15.155:0/46108828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 msgr2=0x7f9ec00ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/46108828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00ccc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009910 tx=0x7f9eb00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- 172.21.15.155:0/46108828 shutdown_connections 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/46108828 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00ccc10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- 172.21.15.155:0/46108828 >> 172.21.15.155:0/46108828 conn(0x7f9ec00682c0 msgr2=0x7f9ec00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- 172.21.15.155:0/46108828 shutdown_connections 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- 172.21.15.155:0/46108828 wait complete. 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 Processor -- start 2024-08-17T02:27:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.804+0000 7f9ec82ce700 1 -- start start 2024-08-17T02:27:21.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ec00b2210 0x7f9ec015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0169800 con 0x7f9ec00b5750 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0169a10 con 0x7f9ec00b2210 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0169cf0 con 0x7f9ec00cc840 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41920/0 (socket says 172.21.15.155:41920) 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 -- 172.21.15.155:0/255481283 learned_addr learned my addr 172.21.15.155:0/255481283 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec606a700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ec00b2210 0x7f9ec015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec686b700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 -- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 msgr2=0x7f9ec00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 -- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ec00b2210 msgr2=0x7f9ec015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ec00b2210 0x7f9ec015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 -- 172.21.15.155:0/255481283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009420 con 0x7f9ec00b5750 2024-08-17T02:27:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec5869700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c790 tx=0x7f9eb4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4005b30 con 0x7f9ec00b5750 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4005c90 con 0x7f9ec00b5750 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec0169fd0 con 0x7f9ec00b5750 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4007300 con 0x7f9ec00b5750 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec016a590 con 0x7f9ec00b5750 2024-08-17T02:27:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.808+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0067b60 con 0x7f9ec00b5750 2024-08-17T02:27:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.812+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9eb401b3b0 con 0x7f9ec00b5750 2024-08-17T02:27:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.812+0000 7f9ebe7fc700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 0x7f9eac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.812+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9eb407c040 con 0x7f9ec00b5750 2024-08-17T02:27:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.812+0000 7f9ec606a700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 0x7f9eac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.812+0000 7f9ec606a700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 0x7f9eac062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0152f30 tx=0x7f9eb0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:21.820+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9eb404c4f0 con 0x7f9ec00b5750 2024-08-17T02:27:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.020+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9ec00645c0 con 0x7f9ec00b5750 2024-08-17T02:27:22.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.692+0000 7f9ebe7fc700 1 -- 172.21.15.155:0/255481283 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9eb404fb10 con 0x7f9ec00b5750 2024-08-17T02:27:22.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.700+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 msgr2=0x7f9eac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.700+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 0x7f9eac062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0152f30 tx=0x7f9eb0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.700+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 msgr2=0x7f9ec01517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.700+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c790 tx=0x7f9eb4007ea0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 shutdown_connections 2024-08-17T02:27:22.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9eac060860 0x7f9eac062d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ec00cc840 0x7f9ec00b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec00b5750 0x7f9ec01517d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 --2- 172.21.15.155:0/255481283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ec00b2210 0x7f9ec015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.704+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 >> 172.21.15.155:0/255481283 conn(0x7f9ec00682c0 msgr2=0x7f9ec00b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.708+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 shutdown_connections 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.708+0000 7f9ec82ce700 1 -- 172.21.15.155:0/255481283 wait complete. 2024-08-17T02:27:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:27:22.729 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:22.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.824+0000 7f576a065700 1 Processor -- start 2024-08-17T02:27:22.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.824+0000 7f576a065700 1 -- start start 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f576a065700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f57640c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f576a065700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5764158000 0x7f57640adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f576a065700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640ad670 con 0x7f57640ae040 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f576a065700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640acd80 con 0x7f5764158000 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f576a065700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5764157440 con 0x7f5764157070 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5764158000 0x7f57640adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5764158000 0x7f57640adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41922/0 (socket says 172.21.15.155:41922) 2024-08-17T02:27:22.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 -- 172.21.15.155:0/1628648659 learned_addr learned my addr 172.21.15.155:0/1628648659 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:22.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5769063700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f57640c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 -- 172.21.15.155:0/1628648659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 msgr2=0x7f57640c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f57640c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 -- 172.21.15.155:0/1628648659 >> v1:172.21.15.155:6789/0 conn(0x7f57640ae040 legacy=0x7f57640c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 -- 172.21.15.155:0/1628648659 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57641585d0 con 0x7f5764158000 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f5768862700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5764158000 0x7f57640adb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57540099b0 tx=0x7f5754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f360ae6cd337fe4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f575bfff700 1 -- 172.21.15.155:0/1628648659 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400b860 con 0x7f5764158000 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f575bfff700 1 -- 172.21.15.155:0/1628648659 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400b9c0 con 0x7f5764158000 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.828+0000 7f575bfff700 1 -- 172.21.15.155:0/1628648659 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400bd60 con 0x7f5764158000 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- 172.21.15.155:0/1628648659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5764158000 msgr2=0x7f57640adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5764158000 0x7f57640adb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57540099b0 tx=0x7f5754009250 comp rx=0 tx=0).stop 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- 172.21.15.155:0/1628648659 shutdown_connections 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5764158000 0x7f57640adb00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- 172.21.15.155:0/1628648659 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f57640c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- 172.21.15.155:0/1628648659 >> 172.21.15.155:0/1628648659 conn(0x7f57640ccfc0 msgr2=0x7f57640c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- 172.21.15.155:0/1628648659 shutdown_connections 2024-08-17T02:27:22.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- 172.21.15.155:0/1628648659 wait complete. 2024-08-17T02:27:22.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 Processor -- start 2024-08-17T02:27:22.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- start start 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f576414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5764158000 0x7f576414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764150280 con 0x7f57640ae040 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576414a900 con 0x7f5764158000 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f576a065700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576414f670 con 0x7f5764157070 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f5769063700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f5769063700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41936/0 (socket says 172.21.15.155:41936) 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f5769063700 1 -- 172.21.15.155:0/4087379964 learned_addr learned my addr 172.21.15.155:0/4087379964 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f5768862700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f576414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.832+0000 7f5769864700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5764158000 0x7f576414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 -- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 msgr2=0x7f576414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f576414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 -- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5764158000 msgr2=0x7f576414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5764158000 0x7f576414edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 -- 172.21.15.155:0/4087379964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540094f0 con 0x7f57640ae040 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f5769063700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f576000d890 tx=0x7f5760008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600125f0 con 0x7f57640ae040 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760012750 con 0x7f57640ae040 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576414f950 con 0x7f57640ae040 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760012af0 con 0x7f57640ae040 2024-08-17T02:27:22.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576414ff10 con 0x7f57640ae040 2024-08-17T02:27:22.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.836+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57640638f0 con 0x7f57640ae040 2024-08-17T02:27:22.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.840+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f576001e460 con 0x7f57640ae040 2024-08-17T02:27:22.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.840+0000 7f57597fa700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 0x7f5748062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.840+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f576007d110 con 0x7f57640ae040 2024-08-17T02:27:22.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.840+0000 7f5768862700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 0x7f5748062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.840+0000 7f5768862700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 0x7f5748062d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57540099b0 tx=0x7f5754017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:22.844+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5760050ff0 con 0x7f57640ae040 2024-08-17T02:27:23.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.008+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5764068270 con 0x7f57640ae040 2024-08-17T02:27:23.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.008+0000 7f57597fa700 1 -- 172.21.15.155:0/4087379964 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f5760050b80 con 0x7f57640ae040 2024-08-17T02:27:23.013 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:23.013 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":20,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:22.024501+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 msgr2=0x7f5748062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 0x7f5748062d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57540099b0 tx=0x7f5754017000 comp rx=0 tx=0).stop 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 msgr2=0x7f5764159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f576000d890 tx=0x7f5760008040 comp rx=0 tx=0).stop 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 shutdown_connections 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5748060890 0x7f5748062d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5764158000 0x7f576414edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5764157070 0x7f576414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 --2- 172.21.15.155:0/4087379964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640ae040 0x7f5764159850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 >> 172.21.15.155:0/4087379964 conn(0x7f57640ccfc0 msgr2=0x7f5764151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 shutdown_connections 2024-08-17T02:27:23.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.012+0000 7f576a065700 1 -- 172.21.15.155:0/4087379964 wait complete. 2024-08-17T02:27:23.028 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:23.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 Processor -- start 2024-08-17T02:27:23.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- start start 2024-08-17T02:27:23.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f186c0b1630 0x7f186c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c141a00 con 0x7f186c0b0d20 2024-08-17T02:27:23.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c140b10 con 0x7f186c0b1630 2024-08-17T02:27:23.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c140df0 con 0x7f186c06e620 2024-08-17T02:27:23.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871454700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f186c0b0d20 0x7f186c06df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42338/0 (socket says 172.21.15.155:42338) 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871454700 1 -- 172.21.15.155:0/1874912273 learned_addr learned my addr 172.21.15.155:0/1874912273 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 --2- 172.21.15.155:0/1874912273 >> v2:172.21.15.155:3300/0 conn(0x7f186c0b1630 0x7f186c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1870c53700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1863fff700 1 -- 172.21.15.155:0/1874912273 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091928671 0 0) 0x7f186c141a00 con 0x7f186c0b0d20 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1863fff700 1 -- 172.21.15.155:0/1874912273 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1858003570 con 0x7f186c0b0d20 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 -- 172.21.15.155:0/1874912273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 msgr2=0x7f186c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 -- 172.21.15.155:0/1874912273 >> v1:172.21.15.155:6789/0 conn(0x7f186c0b0d20 legacy=0x7f186c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 -- 172.21.15.155:0/1874912273 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c1410d0 con 0x7f186c0b1630 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1871c55700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b1630 0x7f186c141e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f18680098e0 tx=0x7f18680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10317ed9823849a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1863fff700 1 -- 172.21.15.155:0/1874912273 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868011630 con 0x7f186c0b1630 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1863fff700 1 -- 172.21.15.155:0/1874912273 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868011790 con 0x7f186c0b1630 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1863fff700 1 -- 172.21.15.155:0/1874912273 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868011b30 con 0x7f186c0b1630 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- 172.21.15.155:0/1874912273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b1630 msgr2=0x7f186c141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b1630 0x7f186c141e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f18680098e0 tx=0x7f18680091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- 172.21.15.155:0/1874912273 shutdown_connections 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b1630 0x7f186c141e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 --2- 172.21.15.155:0/1874912273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- 172.21.15.155:0/1874912273 >> 172.21.15.155:0/1874912273 conn(0x7f186c0678d0 msgr2=0x7f186c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- 172.21.15.155:0/1874912273 shutdown_connections 2024-08-17T02:27:23.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.132+0000 7f1872456700 1 -- 172.21.15.155:0/1874912273 wait complete. 2024-08-17T02:27:23.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 Processor -- start 2024-08-17T02:27:23.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 -- start start 2024-08-17T02:27:23.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 0x7f186c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1455f0 con 0x7f186c0b0d20 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1458d0 con 0x7f186c0b1630 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1872456700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c145bb0 con 0x7f186c06e620 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1870c53700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1870c53700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41954/0 (socket says 172.21.15.155:41954) 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1870c53700 1 -- 172.21.15.155:0/3326693958 learned_addr learned my addr 172.21.15.155:0/3326693958 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1870c53700 1 -- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 msgr2=0x7f186c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.136+0000 7f1871454700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1871c55700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 0x7f186c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1870c53700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1870c53700 1 -- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 msgr2=0x7f186c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1870c53700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 0x7f186c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1870c53700 1 -- 172.21.15.155:0/3326693958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868009420 con 0x7f186c0b0d20 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1871454700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1871c55700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 0x7f186c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:23.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1870c53700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1864009e50 tx=0x7f186400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400cc20 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400f040 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c145e90 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864014480 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0ae080 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c0643a0 con 0x7f186c0b0d20 2024-08-17T02:27:23.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f18640147f0 con 0x7f186c0b0d20 2024-08-17T02:27:23.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 0x7f1850062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1871454700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 0x7f1850062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f186407d570 con 0x7f186c0b0d20 2024-08-17T02:27:23.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.140+0000 7f1871454700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 0x7f1850062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.148+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f186404d9c0 con 0x7f186c0b0d20 2024-08-17T02:27:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.316+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186c06f5f0 con 0x7f186c0b0d20 2024-08-17T02:27:23.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.316+0000 7f18617fa700 1 -- 172.21.15.155:0/3326693958 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f1864050fe0 con 0x7f186c0b0d20 2024-08-17T02:27:23.321 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:23.321 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":20,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:22.024501+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 msgr2=0x7f1850062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 0x7f1850062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 msgr2=0x7f186c0adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1864009e50 tx=0x7f186400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 shutdown_connections 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1850060860 0x7f1850062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f186c0b1630 0x7f186c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f186c0b0d20 0x7f186c0adb40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 --2- 172.21.15.155:0/3326693958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f186c06e620 0x7f186c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 >> 172.21.15.155:0/3326693958 conn(0x7f186c0678d0 msgr2=0x7f186c063720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 shutdown_connections 2024-08-17T02:27:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.320+0000 7f1872456700 1 -- 172.21.15.155:0/3326693958 wait complete. 2024-08-17T02:27:23.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:23.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.448+0000 7f9a311c2700 1 Processor -- start 2024-08-17T02:27:23.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.448+0000 7f9a311c2700 1 -- start start 2024-08-17T02:27:23.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c158ec0 0x7f9a2c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a2c067510 0x7f9a2c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0b2f80 con 0x7f9a2c159290 2024-08-17T02:27:23.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0cf210 con 0x7f9a2c067510 2024-08-17T02:27:23.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0cf4b0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a2c067510 0x7f9a2c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a2c067510 0x7f9a2c0b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41966/0 (socket says 172.21.15.155:41966) 2024-08-17T02:27:23.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 -- 172.21.15.155:0/715770450 learned_addr learned my addr 172.21.15.155:0/715770450 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:23.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a2bfff700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c158ec0 0x7f9a2c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 -- 172.21.15.155:0/715770450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c158ec0 msgr2=0x7f9a2c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c158ec0 0x7f9a2c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 -- 172.21.15.155:0/715770450 >> v1:172.21.15.189:6789/0 conn(0x7f9a2c159290 legacy=0x7f9a2c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 -- 172.21.15.155:0/715770450 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0cf790 con 0x7f9a2c067510 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a309c1700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c067510 0x7f9a2c0b3410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009f20 tx=0x7f9a24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f5bf91f014d332 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a2b7fe700 1 -- 172.21.15.155:0/715770450 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400e070 con 0x7f9a2c067510 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a2b7fe700 1 -- 172.21.15.155:0/715770450 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400b9d0 con 0x7f9a2c067510 2024-08-17T02:27:23.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a2b7fe700 1 -- 172.21.15.155:0/715770450 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240092e0 con 0x7f9a2c067510 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- 172.21.15.155:0/715770450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c067510 msgr2=0x7f9a2c0b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c067510 0x7f9a2c0b3410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009f20 tx=0x7f9a24009840 comp rx=0 tx=0).stop 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- 172.21.15.155:0/715770450 shutdown_connections 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c067510 0x7f9a2c0b3410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 --2- 172.21.15.155:0/715770450 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c158ec0 0x7f9a2c0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- 172.21.15.155:0/715770450 >> 172.21.15.155:0/715770450 conn(0x7f9a2c06a3b0 msgr2=0x7f9a2c0b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- 172.21.15.155:0/715770450 shutdown_connections 2024-08-17T02:27:23.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.452+0000 7f9a311c2700 1 -- 172.21.15.155:0/715770450 wait complete. 2024-08-17T02:27:23.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 Processor -- start 2024-08-17T02:27:23.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- start start 2024-08-17T02:27:23.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a2c067510 0x7f9a2c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c159290 0x7f9a2c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c74d0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c68c0 con 0x7f9a2c067510 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c6ba0 con 0x7f9a2c159290 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a309c1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c159290 0x7f9a2c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41968/0 (socket says 172.21.15.155:41968) 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 -- 172.21.15.155:0/1528809321 learned_addr learned my addr 172.21.15.155:0/1528809321 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:23.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a2bfff700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a2c067510 0x7f9a2c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 -- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c159290 msgr2=0x7f9a2c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c159290 0x7f9a2c143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 -- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a2c067510 msgr2=0x7f9a2c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a2c067510 0x7f9a2c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 -- 172.21.15.155:0/1528809321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24009ae0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a237fe700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c4e0 tx=0x7f9a1400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011590 con 0x7f9a2c158ec0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14011710 con 0x7f9a2c158ec0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0c6e80 con 0x7f9a2c158ec0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011ad0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.456+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c1551c0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c0c7680 con 0x7f9a2c158ec0 2024-08-17T02:27:23.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9a1401b3b0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a28ff9700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 0x7f9a10062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a2bfff700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 0x7f9a10062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a1407bfd0 con 0x7f9a2c158ec0 2024-08-17T02:27:23.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.460+0000 7f9a2bfff700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 0x7f9a10062d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009db0 tx=0x7f9a1c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.468+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9a2c0c7680 con 0x7f9a2c158ec0 2024-08-17T02:27:23.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.664+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9a2c064330 con 0x7f9a2c158ec0 2024-08-17T02:27:23.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a28ff9700 1 -- 172.21.15.155:0/1528809321 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a14017020 con 0x7f9a2c158ec0 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 msgr2=0x7f9a10062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 0x7f9a10062d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009db0 tx=0x7f9a1c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 msgr2=0x7f9a2c0c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c4e0 tx=0x7f9a1400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 shutdown_connections 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a10060890 0x7f9a10062d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9a2c159290 0x7f9a2c143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a2c158ec0 0x7f9a2c0c5e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 --2- 172.21.15.155:0/1528809321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a2c067510 0x7f9a2c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 >> 172.21.15.155:0/1528809321 conn(0x7f9a2c06a3b0 msgr2=0x7f9a2c15a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 shutdown_connections 2024-08-17T02:27:23.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.708+0000 7f9a311c2700 1 -- 172.21.15.155:0/1528809321 wait complete. 2024-08-17T02:27:23.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:23.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 Processor -- start 2024-08-17T02:27:23.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 -- start start 2024-08-17T02:27:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f943c15a6c0 0x7f943c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f943c0ca110 0x7f943c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c0b1160 con 0x7f943c157740 2024-08-17T02:27:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c140ee0 con 0x7f943c15a6c0 2024-08-17T02:27:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9444561700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c159220 con 0x7f943c0ca110 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9441afc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f943c15a6c0 0x7f943c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f94422fd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f943c157740 0x7f943c0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49256/0 (socket says 172.21.15.155:49256) 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9441afc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f943c15a6c0 0x7f943c157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49896/0 (socket says 172.21.15.155:49896) 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f94422fd700 1 -- 172.21.15.155:0/4198019849 learned_addr learned my addr 172.21.15.155:0/4198019849 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9442afe700 1 --2- 172.21.15.155:0/4198019849 >> v2:172.21.15.189:3300/0 conn(0x7f943c0ca110 0x7f943c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9441afc700 1 -- 172.21.15.155:0/4198019849 >> v2:172.21.15.189:3300/0 conn(0x7f943c0ca110 msgr2=0x7f943c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.832+0000 7f9441afc700 1 --2- 172.21.15.155:0/4198019849 >> v2:172.21.15.189:3300/0 conn(0x7f943c0ca110 0x7f943c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9441afc700 1 -- 172.21.15.155:0/4198019849 >> v1:172.21.15.155:6789/0 conn(0x7f943c157740 legacy=0x7f943c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f94412fb700 1 -- 172.21.15.155:0/4198019849 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901784660 0 0) 0x7f9438001110 con 0x7f943c157740 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9441afc700 1 -- 172.21.15.155:0/4198019849 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c1588f0 con 0x7f943c15a6c0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9441afc700 1 --2- 172.21.15.155:0/4198019849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c15a6c0 0x7f943c157b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f943c0b06d0 tx=0x7f942c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e144f8c16bc45d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f94412fb700 1 -- 172.21.15.155:0/4198019849 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00b6b0 con 0x7f943c15a6c0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f94412fb700 1 -- 172.21.15.155:0/4198019849 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00b810 con 0x7f943c15a6c0 2024-08-17T02:27:23.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f94412fb700 1 -- 172.21.15.155:0/4198019849 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00bbb0 con 0x7f943c15a6c0 2024-08-17T02:27:23.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- 172.21.15.155:0/4198019849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c15a6c0 msgr2=0x7f943c157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 --2- 172.21.15.155:0/4198019849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c15a6c0 0x7f943c157b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f943c0b06d0 tx=0x7f942c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- 172.21.15.155:0/4198019849 shutdown_connections 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 --2- 172.21.15.155:0/4198019849 >> v2:172.21.15.189:3300/0 conn(0x7f943c0ca110 0x7f943c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 --2- 172.21.15.155:0/4198019849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c15a6c0 0x7f943c157b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- 172.21.15.155:0/4198019849 >> 172.21.15.155:0/4198019849 conn(0x7f943c0cd980 msgr2=0x7f943c0c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- 172.21.15.155:0/4198019849 shutdown_connections 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- 172.21.15.155:0/4198019849 wait complete. 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 Processor -- start 2024-08-17T02:27:23.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 -- start start 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.836+0000 7f9444561700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f943c157740 0x7f943c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 0x7f943c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c7de0 con 0x7f943c0ca110 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c13cfc0 con 0x7f943c15a6c0 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c13cce0 con 0x7f943c157740 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49908/0 (socket says 172.21.15.155:49908) 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 -- 172.21.15.155:0/1206184072 learned_addr learned my addr 172.21.15.155:0/1206184072 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:23.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9441afc700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f943c157740 0x7f943c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9442afe700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 0x7f943c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 -- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f943c157740 msgr2=0x7f943c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f943c157740 0x7f943c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 -- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 msgr2=0x7f943c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 0x7f943c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 -- 172.21.15.155:0/1206184072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009420 con 0x7f943c0ca110 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9442afe700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 0x7f943c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94422fd700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f943800c810 tx=0x7f9438007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438005b30 con 0x7f943c0ca110 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438005c90 con 0x7f943c0ca110 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0c7720 con 0x7f943c0ca110 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380072e0 con 0x7f943c0ca110 2024-08-17T02:27:23.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c14bd40 con 0x7f943c0ca110 2024-08-17T02:27:23.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0644b0 con 0x7f943c0ca110 2024-08-17T02:27:23.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94380076d0 con 0x7f943c0ca110 2024-08-17T02:27:23.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.840+0000 7f94327fc700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.844+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f943807bde0 con 0x7f943c0ca110 2024-08-17T02:27:23.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.844+0000 7f9441afc700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.844+0000 7f9441afc700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 0x7f9420062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f942c0091e0 tx=0x7f942c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:23.852+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f943804a480 con 0x7f943c0ca110 2024-08-17T02:27:24.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.048+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f943c0b1160 con 0x7f943c0ca110 2024-08-17T02:27:24.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.720+0000 7f94327fc700 1 -- 172.21.15.155:0/1206184072 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f943c0b1160 con 0x7f943c0ca110 2024-08-17T02:27:24.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 msgr2=0x7f9420062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 0x7f9420062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f942c0091e0 tx=0x7f942c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 msgr2=0x7f943c14b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f943800c810 tx=0x7f9438007c50 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 shutdown_connections 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9420060860 0x7f9420062d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f943c15a6c0 0x7f943c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f943c157740 0x7f943c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 --2- 172.21.15.155:0/1206184072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f943c0ca110 0x7f943c14b800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 >> 172.21.15.155:0/1206184072 conn(0x7f943c0cd980 msgr2=0x7f943c157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 shutdown_connections 2024-08-17T02:27:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.724+0000 7f9444561700 1 -- 172.21.15.155:0/1206184072 wait complete. 2024-08-17T02:27:24.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:24.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.848+0000 7f5c6dc44700 1 Processor -- start 2024-08-17T02:27:24.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.848+0000 7f5c6dc44700 1 -- start start 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c68155e00 0x7f5c68159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5c681561d0 0x7f5c6815a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c68069640 con 0x7f5c68069180 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6815aa20 con 0x7f5c681561d0 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68069920 con 0x7f5c68155e00 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c67fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5c68069180 0x7f5c680b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49270/0 (socket says 172.21.15.155:49270) 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c67fff700 1 -- 172.21.15.155:0/3056155702 learned_addr learned my addr 172.21.15.155:0/3056155702 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c677fe700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c68155e00 0x7f5c68159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/3056155702 >> v2:172.21.15.189:3300/0 conn(0x7f5c681561d0 0x7f5c6815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c66ffd700 1 -- 172.21.15.155:0/3056155702 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213916394 0 0) 0x7f5c68069640 con 0x7f5c68069180 2024-08-17T02:27:24.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c66ffd700 1 -- 172.21.15.155:0/3056155702 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c54003570 con 0x7f5c68069180 2024-08-17T02:27:24.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 -- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c68155e00 msgr2=0x7f5c68159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c68155e00 0x7f5c68159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 -- 172.21.15.155:0/3056155702 >> v1:172.21.15.155:6789/0 conn(0x7f5c68069180 legacy=0x7f5c680b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 -- 172.21.15.155:0/3056155702 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68069c00 con 0x7f5c681561d0 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c681561d0 0x7f5c6815a070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c500098e0 tx=0x7f5c500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629ca6c42aa02e0d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c66ffd700 1 -- 172.21.15.155:0/3056155702 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011630 con 0x7f5c681561d0 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c66ffd700 1 -- 172.21.15.155:0/3056155702 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50011790 con 0x7f5c681561d0 2024-08-17T02:27:24.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c66ffd700 1 -- 172.21.15.155:0/3056155702 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011b10 con 0x7f5c681561d0 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c681561d0 msgr2=0x7f5c6815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c681561d0 0x7f5c6815a070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5c500098e0 tx=0x7f5c500091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- 172.21.15.155:0/3056155702 shutdown_connections 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c681561d0 0x7f5c6815a070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/3056155702 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c68155e00 0x7f5c68159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- 172.21.15.155:0/3056155702 >> 172.21.15.155:0/3056155702 conn(0x7f5c6806e3b0 msgr2=0x7f5c680aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- 172.21.15.155:0/3056155702 shutdown_connections 2024-08-17T02:27:24.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.852+0000 7f5c6dc44700 1 -- 172.21.15.155:0/3056155702 wait complete. 2024-08-17T02:27:24.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 Processor -- start 2024-08-17T02:27:24.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 -- start start 2024-08-17T02:27:24.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68155e00 0x7f5c6813da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c681561d0 0x7f5c6813dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6813f210 con 0x7f5c68069180 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6816de90 con 0x7f5c68155e00 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c6dc44700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6813e600 con 0x7f5c681561d0 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c677fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c677fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49916/0 (socket says 172.21.15.155:49916) 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c677fe700 1 -- 172.21.15.155:0/2282306630 learned_addr learned my addr 172.21.15.155:0/2282306630 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c67fff700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c681561d0 0x7f5c6813dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.856+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68155e00 0x7f5c6813da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 -- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c681561d0 msgr2=0x7f5c6813dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c681561d0 0x7f5c6813dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 -- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68155e00 msgr2=0x7f5c6813da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68155e00 0x7f5c6813da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 -- 172.21.15.155:0/2282306630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c50009420 con 0x7f5c68069180 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c677fe700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800ec80 tx=0x7f5c580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58009690 con 0x7f5c68069180 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5800c850 con 0x7f5c68069180 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6813e8e0 con 0x7f5c68069180 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5800cc10 con 0x7f5c68069180 2024-08-17T02:27:24.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6813eea0 con 0x7f5c68069180 2024-08-17T02:27:24.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c680645c0 con 0x7f5c68069180 2024-08-17T02:27:24.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.860+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5c58013470 con 0x7f5c68069180 2024-08-17T02:27:24.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.864+0000 7f5c5f7fe700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 0x7f5c48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.864+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c5807cdd0 con 0x7f5c68069180 2024-08-17T02:27:24.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.864+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 0x7f5c48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.864+0000 7f5c5ffff700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 0x7f5c48062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c500091e0 tx=0x7f5c50017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:24.868+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5c58050cb0 con 0x7f5c68069180 2024-08-17T02:27:25.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.064+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c680b2c40 con 0x7f5c68069180 2024-08-17T02:27:25.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c5f7fe700 1 -- 172.21.15.155:0/2282306630 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f5c58050840 con 0x7f5c68069180 2024-08-17T02:27:25.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:25.071 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 msgr2=0x7f5c48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 0x7f5c48062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c500091e0 tx=0x7f5c50017000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 msgr2=0x7f5c6813d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800ec80 tx=0x7f5c580091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 shutdown_connections 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5c48060860 0x7f5c48062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c681561d0 0x7f5c6813dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68155e00 0x7f5c6813da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 --2- 172.21.15.155:0/2282306630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c68069180 0x7f5c6813d020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 >> 172.21.15.155:0/2282306630 conn(0x7f5c6806e3b0 msgr2=0x7f5c681515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 shutdown_connections 2024-08-17T02:27:25.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.068+0000 7f5c6dc44700 1 -- 172.21.15.155:0/2282306630 wait complete. 2024-08-17T02:27:25.074 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:25.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:25.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 Processor -- start 2024-08-17T02:27:25.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 -- start start 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5cf80af030 0x7f5cf80a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 0x7f5cf80b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80b0270 con 0x7f5cf815d540 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80af660 con 0x7f5cf80af030 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cfc9b8700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80af940 con 0x7f5cf80a9260 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5cf80af030 0x7f5cf80a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5cf80af030 0x7f5cf80a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49920/0 (socket says 172.21.15.155:49920) 2024-08-17T02:27:25.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 -- 172.21.15.155:0/911873242 learned_addr learned my addr 172.21.15.155:0/911873242 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf6d9d700 1 --2- 172.21.15.155:0/911873242 >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 0x7f5cf80b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 -- 172.21.15.155:0/911873242 >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 msgr2=0x7f5cf80b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 --2- 172.21.15.155:0/911873242 >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 0x7f5cf80b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf559a700 1 -- 172.21.15.155:0/911873242 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978185063 0 0) 0x7f5cf80b0270 con 0x7f5cf815d540 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 -- 172.21.15.155:0/911873242 >> v1:172.21.15.155:6789/0 conn(0x7f5cf815d540 legacy=0x7f5cf806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 -- 172.21.15.155:0/911873242 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80afc20 con 0x7f5cf80af030 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf6d9d700 1 --2- 172.21.15.155:0/911873242 >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 0x7f5cf80b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf5d9b700 1 --2- 172.21.15.155:0/911873242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf80af030 0x7f5cf80a8d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cf806ccc0 tx=0x7f5cf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3593b3701184e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf559a700 1 -- 172.21.15.155:0/911873242 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000e070 con 0x7f5cf80af030 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf559a700 1 -- 172.21.15.155:0/911873242 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000ba50 con 0x7f5cf80af030 2024-08-17T02:27:25.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.188+0000 7f5cf559a700 1 -- 172.21.15.155:0/911873242 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00092e0 con 0x7f5cf80af030 2024-08-17T02:27:25.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/911873242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf80af030 msgr2=0x7f5cf80a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/911873242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf80af030 0x7f5cf80a8d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cf806ccc0 tx=0x7f5cf0009840 comp rx=0 tx=0).stop 2024-08-17T02:27:25.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/911873242 shutdown_connections 2024-08-17T02:27:25.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/911873242 >> v2:172.21.15.189:3300/0 conn(0x7f5cf80a9260 0x7f5cf80b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/911873242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf80af030 0x7f5cf80a8d20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/911873242 >> 172.21.15.155:0/911873242 conn(0x7f5cf8066e00 msgr2=0x7f5cf8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/911873242 shutdown_connections 2024-08-17T02:27:25.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/911873242 wait complete. 2024-08-17T02:27:25.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 Processor -- start 2024-08-17T02:27:25.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- start start 2024-08-17T02:27:25.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cf80a9260 0x7f5cf80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cf80af030 0x7f5cf8098f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8098360 con 0x7f5cf815d540 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80976e0 con 0x7f5cf80af030 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cfc9b8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80979c0 con 0x7f5cf80a9260 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cf6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cf6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49922/0 (socket says 172.21.15.155:49922) 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cf6d9d700 1 -- 172.21.15.155:0/2719543836 learned_addr learned my addr 172.21.15.155:0/2719543836 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cf659c700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cf80a9260 0x7f5cf80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.192+0000 7f5cf5d9b700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cf80af030 0x7f5cf8098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 -- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cf80a9260 msgr2=0x7f5cf80ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cf80a9260 0x7f5cf80ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 -- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cf80af030 msgr2=0x7f5cf8098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cf80af030 0x7f5cf8098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 -- 172.21.15.155:0/2719543836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009ae0 con 0x7f5cf815d540 2024-08-17T02:27:25.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cf6d9d700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c880 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011600 con 0x7f5cf815d540 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8011760 con 0x7f5cf815d540 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf8097ca0 con 0x7f5cf815d540 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011b20 con 0x7f5cf815d540 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf80973b0 con 0x7f5cf815d540 2024-08-17T02:27:25.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf80984a0 con 0x7f5cf815d540 2024-08-17T02:27:25.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.196+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ce80193b0 con 0x7f5cf815d540 2024-08-17T02:27:25.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.200+0000 7f5cee7fc700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 0x7f5cd8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.200+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ce807c810 con 0x7f5cf815d540 2024-08-17T02:27:25.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.200+0000 7f5cf659c700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 0x7f5cd8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.200+0000 7f5cf659c700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 0x7f5cd8062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8098ad0 tx=0x7f5ce0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.208+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5ce80507a0 con 0x7f5cf815d540 2024-08-17T02:27:25.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.372+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf80645c0 con 0x7f5cf815d540 2024-08-17T02:27:25.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.376+0000 7f5cee7fc700 1 -- 172.21.15.155:0/2719543836 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5ce8015090 con 0x7f5cf815d540 2024-08-17T02:27:25.380 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:25.380 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 msgr2=0x7f5cd8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 0x7f5cd8062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8098ad0 tx=0x7f5ce0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 msgr2=0x7f5cf8099490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c880 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 shutdown_connections 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5cd8060860 0x7f5cd8062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf815d540 0x7f5cf8099490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cf80af030 0x7f5cf8098f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 --2- 172.21.15.155:0/2719543836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5cf80a9260 0x7f5cf80ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 >> 172.21.15.155:0/2719543836 conn(0x7f5cf8066e00 msgr2=0x7f5cf806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 shutdown_connections 2024-08-17T02:27:25.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.380+0000 7f5cfc9b8700 1 -- 172.21.15.155:0/2719543836 wait complete. 2024-08-17T02:27:25.394 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:25.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:25.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.496+0000 7f4dc8db8700 1 Processor -- start 2024-08-17T02:27:25.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.496+0000 7f4dc8db8700 1 -- start start 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4dc40aedf0 0x7f4dc40af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4dc4067690 0x7f4dc4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40c95f0 con 0x7f4dc4156ab0 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b28c0 con 0x7f4dc40aedf0 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b1f90 con 0x7f4dc4067690 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4dc4156ab0 0x7f4dc4156f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49300/0 (socket says 172.21.15.155:49300) 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc3fff700 1 -- 172.21.15.155:0/943767866 learned_addr learned my addr 172.21.15.155:0/943767866 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:25.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/943767866 >> v2:172.21.15.155:3300/0 conn(0x7f4dc40aedf0 0x7f4dc40af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dbaffd700 1 --2- 172.21.15.155:0/943767866 >> v2:172.21.15.189:3300/0 conn(0x7f4dc4067690 0x7f4dc4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 -- 172.21.15.155:0/943767866 >> v2:172.21.15.189:3300/0 conn(0x7f4dc4067690 msgr2=0x7f4dc4067fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/943767866 >> v2:172.21.15.189:3300/0 conn(0x7f4dc4067690 0x7f4dc4067fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 -- 172.21.15.155:0/943767866 >> v1:172.21.15.155:6789/0 conn(0x7f4dc4156ab0 legacy=0x7f4dc4156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 -- 172.21.15.155:0/943767866 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40b2270 con 0x7f4dc40aedf0 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/943767866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc40aedf0 0x7f4dc40af1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4070360 tx=0x7f4db40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2944b117947ae4ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc2ffd700 1 -- 172.21.15.155:0/943767866 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011630 con 0x7f4dc40aedf0 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc2ffd700 1 -- 172.21.15.155:0/943767866 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4011790 con 0x7f4dc40aedf0 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc2ffd700 1 -- 172.21.15.155:0/943767866 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011b30 con 0x7f4dc40aedf0 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- 172.21.15.155:0/943767866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc40aedf0 msgr2=0x7f4dc40af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/943767866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc40aedf0 0x7f4dc40af1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4070360 tx=0x7f4db40091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- 172.21.15.155:0/943767866 shutdown_connections 2024-08-17T02:27:25.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/943767866 >> v2:172.21.15.189:3300/0 conn(0x7f4dc4067690 0x7f4dc4067fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/943767866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc40aedf0 0x7f4dc40af1c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- 172.21.15.155:0/943767866 >> 172.21.15.155:0/943767866 conn(0x7f4dc40ca2b0 msgr2=0x7f4dc406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- 172.21.15.155:0/943767866 shutdown_connections 2024-08-17T02:27:25.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.500+0000 7f4dc8db8700 1 -- 172.21.15.155:0/943767866 wait complete. 2024-08-17T02:27:25.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.504+0000 7f4dc8db8700 1 Processor -- start 2024-08-17T02:27:25.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.504+0000 7f4dc8db8700 1 -- start start 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc4067690 0x7f4dc40adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc40aedf0 0x7f4dc4169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ad910 con 0x7f4dc4156ab0 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ae2e0 con 0x7f4dc40aedf0 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc416a450 con 0x7f4dc4067690 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49938/0 (socket says 172.21.15.155:49938) 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 -- 172.21.15.155:0/1429796859 learned_addr learned my addr 172.21.15.155:0/1429796859 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc4067690 0x7f4dc40adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dbaffd700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc40aedf0 0x7f4dc4169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 -- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc4067690 msgr2=0x7f4dc40adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc4067690 0x7f4dc40adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 -- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc40aedf0 msgr2=0x7f4dc4169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc40aedf0 0x7f4dc4169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 -- 172.21.15.155:0/1429796859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009420 con 0x7f4dc4156ab0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc3fff700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00cbc0 tx=0x7f4dbc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00a7a0 con 0x7f4dc4156ab0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00a900 con 0x7f4dc4156ab0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40acd00 con 0x7f4dc4156ab0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00aca0 con 0x7f4dc4156ab0 2024-08-17T02:27:25.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40ad2c0 con 0x7f4dc4156ab0 2024-08-17T02:27:25.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.508+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4dbc007300 con 0x7f4dc4156ab0 2024-08-17T02:27:25.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.512+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40ada80 con 0x7f4dc4156ab0 2024-08-17T02:27:25.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.512+0000 7f4dbbfff700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 0x7f4da4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.512+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dbc07ce10 con 0x7f4dc4156ab0 2024-08-17T02:27:25.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.512+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 0x7f4da4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.512+0000 7f4dc37fe700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 0x7f4da4062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4db40093f0 tx=0x7f4db4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.516+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4dbc04d300 con 0x7f4dc4156ab0 2024-08-17T02:27:25.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.676+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dc40643a0 con 0x7f4da4060860 2024-08-17T02:27:25.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.684+0000 7f4dbbfff700 1 -- 172.21.15.155:0/1429796859 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253745 (secure 0 0 0) 0x7f4dc40643a0 con 0x7f4da4060860 2024-08-17T02:27:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 msgr2=0x7f4da4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 0x7f4da4062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4db40093f0 tx=0x7f4db4017000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 msgr2=0x7f4dc4140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00cbc0 tx=0x7f4dbc0019b0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 shutdown_connections 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4da4060860 0x7f4da4062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dc4156ab0 0x7f4dc4140f00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc40aedf0 0x7f4dc4169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 --2- 172.21.15.155:0/1429796859 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc4067690 0x7f4dc40adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 >> 172.21.15.155:0/1429796859 conn(0x7f4dc40ca2b0 msgr2=0x7f4dc40b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 shutdown_connections 2024-08-17T02:27:25.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.688+0000 7f4dc8db8700 1 -- 172.21.15.155:0/1429796859 wait complete. 2024-08-17T02:27:25.694 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:25.703 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-08-17T02:27:23.937936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385820,"kb_used_data":2496,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588900,"statfs":{"total":773094113280,"available":770651033600,"internally_reserved":0,"allocated":2555904,"data_stored":1598110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.281124"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662087+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660861+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665359+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659190+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.669042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656739+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662064+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656958+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660141+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663934+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665397+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664015+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664259+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662000+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665845+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:27:19.368385+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:19.368385+0000","last_peered":"2024-08-17T02:27:19.368385+0000","last_clean":"2024-08-17T02:27:19.368385+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:19.368385+0000","last_undegraded":"2024-08-17T02:27:19.368385+0000","last_fullsized":"2024-08-17T02:27:19.368385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657872+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657485+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656804+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:59.950188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.658965+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663084+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657901+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661634+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657896+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664874+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:53.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661907+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664592+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:32:16.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659480+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664200+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664079+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662119+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664157+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":753664,"data_stored":638027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":757760,"data_stored":639038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.913}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:25.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 Processor -- start 2024-08-17T02:27:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 -- start start 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c4415c620 0x7f9c440b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415cd90 0x7f9c440acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c440c86e0 con 0x7f9c440acfe0 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c440cb850 con 0x7f9c4415c620 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4ae4e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440ad3f0 con 0x7f9c4415cd90 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c49e4c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c4415c620 0x7f9c440b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4a64d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9c440acfe0 0x7f9c440cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49312/0 (socket says 172.21.15.155:49312) 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4a64d700 1 -- 172.21.15.155:0/2055697118 learned_addr learned my addr 172.21.15.155:0/2055697118 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c4964b700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415cd90 0x7f9c440acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c48e4a700 1 -- 172.21.15.155:0/2055697118 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679774342 0 0) 0x7f9c440c86e0 con 0x7f9c440acfe0 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.812+0000 7f9c48e4a700 1 -- 172.21.15.155:0/2055697118 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c003570 con 0x7f9c440acfe0 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c49e4c700 1 -- 172.21.15.155:0/2055697118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415cd90 msgr2=0x7f9c440acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c49e4c700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415cd90 0x7f9c440acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c49e4c700 1 -- 172.21.15.155:0/2055697118 >> v1:172.21.15.155:6789/0 conn(0x7f9c440acfe0 legacy=0x7f9c440cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c49e4c700 1 -- 172.21.15.155:0/2055697118 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4415d1e0 con 0x7f9c4415c620 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c49e4c700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c4415c620 0x7f9c440b0320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098e0 tx=0x7f9c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d89e6cdfb1f6bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c48e4a700 1 -- 172.21.15.155:0/2055697118 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011630 con 0x7f9c4415c620 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c48e4a700 1 -- 172.21.15.155:0/2055697118 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34011790 con 0x7f9c4415c620 2024-08-17T02:27:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c48e4a700 1 -- 172.21.15.155:0/2055697118 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011b30 con 0x7f9c4415c620 2024-08-17T02:27:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/2055697118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c4415c620 msgr2=0x7f9c440b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c4415c620 0x7f9c440b0320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098e0 tx=0x7f9c340091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/2055697118 shutdown_connections 2024-08-17T02:27:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415cd90 0x7f9c440acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/2055697118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c4415c620 0x7f9c440b0320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/2055697118 >> 172.21.15.155:0/2055697118 conn(0x7f9c440ca900 msgr2=0x7f9c440cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/2055697118 shutdown_connections 2024-08-17T02:27:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.816+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/2055697118 wait complete. 2024-08-17T02:27:25.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 Processor -- start 2024-08-17T02:27:25.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- start start 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415c620 0x7f9c4416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 0x7f9c440aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4416a730 con 0x7f9c440acfe0 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440ac0f0 con 0x7f9c4415cd90 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440c5390 con 0x7f9c4415c620 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49954/0 (socket says 172.21.15.155:49954) 2024-08-17T02:27:25.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 -- 172.21.15.155:0/3491245820 learned_addr learned my addr 172.21.15.155:0/3491245820 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:25.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4964b700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415c620 0x7f9c4416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4a64d700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 0x7f9c440aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 -- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415c620 msgr2=0x7f9c4416a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415c620 0x7f9c4416a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 -- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 msgr2=0x7f9c440aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 0x7f9c440aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 -- 172.21.15.155:0/3491245820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c34009420 con 0x7f9c440acfe0 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4a64d700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 0x7f9c440aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c49e4c700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406e690 tx=0x7f9c34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011b10 con 0x7f9c440acfe0 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340253f0 con 0x7f9c440acfe0 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340257b0 con 0x7f9c440acfe0 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c440c5670 con 0x7f9c440acfe0 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.820+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c440c5c30 con 0x7f9c440acfe0 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.824+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c440643a0 con 0x7f9c440acfe0 2024-08-17T02:27:25.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.824+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c34025ba0 con 0x7f9c440acfe0 2024-08-17T02:27:25.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.824+0000 7f9c41ffb700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 0x7f9c30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.824+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c3407e470 con 0x7f9c440acfe0 2024-08-17T02:27:25.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.824+0000 7f9c4964b700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 0x7f9c30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.828+0000 7f9c4964b700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 0x7f9c30062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ab580 tx=0x7f9c3800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.832+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c3404e820 con 0x7f9c440acfe0 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:25.992+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c440ca5f0 con 0x7f9c30060860 2024-08-17T02:27:26.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.008+0000 7f9c41ffb700 1 -- 172.21.15.155:0/3491245820 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253745 (secure 0 0 0) 0x7f9c440ca5f0 con 0x7f9c30060860 2024-08-17T02:27:26.013 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:26.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 msgr2=0x7f9c30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 0x7f9c30062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ab580 tx=0x7f9c3800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:26.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 msgr2=0x7f9c440c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406e690 tx=0x7f9c34017000 comp rx=0 tx=0).stop 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 shutdown_connections 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c30060860 0x7f9c30062d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c4415cd90 0x7f9c440aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9c4415c620 0x7f9c4416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 --2- 172.21.15.155:0/3491245820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c440acfe0 0x7f9c440c6430 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 >> 172.21.15.155:0/3491245820 conn(0x7f9c440ca900 msgr2=0x7f9c440b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 shutdown_connections 2024-08-17T02:27:26.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.012+0000 7f9c4ae4e700 1 -- 172.21.15.155:0/3491245820 wait complete. 2024-08-17T02:27:26.017 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:26.028 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:27:25.938479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385820,"kb_used_data":2496,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588900,"statfs":{"total":773094113280,"available":770651033600,"internally_reserved":0,"allocated":2555904,"data_stored":1598110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.281667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662087+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660861+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665359+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659190+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.669042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656739+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662064+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656958+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660141+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663934+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665397+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664015+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664259+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662000+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665845+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:27:19.368385+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:19.368385+0000","last_peered":"2024-08-17T02:27:19.368385+0000","last_clean":"2024-08-17T02:27:19.368385+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:19.368385+0000","last_undegraded":"2024-08-17T02:27:19.368385+0000","last_fullsized":"2024-08-17T02:27:19.368385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657872+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657485+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656804+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:59.950188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.658965+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663084+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657901+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661634+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657896+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664874+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:53.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661907+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664592+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:32:16.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659480+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664200+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664079+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662119+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664157+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":753664,"data_stored":638027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":757760,"data_stored":639038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.913}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:26.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:26.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.136+0000 7f8b09b75700 1 Processor -- start 2024-08-17T02:27:26.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.136+0000 7f8b09b75700 1 -- start start 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 0x7f8b0406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8b04156220 0x7f8b0406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040afc10 con 0x7f8b04155e50 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b040b10b0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b040aed20 con 0x7f8b04156220 2024-08-17T02:27:26.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8afbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 0x7f8b0406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8b04156220 0x7f8b0406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8afbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 0x7f8b0406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49966/0 (socket says 172.21.15.155:49966) 2024-08-17T02:27:26.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8afbfff700 1 -- 172.21.15.155:0/2219065678 learned_addr learned my addr 172.21.15.155:0/2219065678 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:26.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 -- 172.21.15.155:0/2219065678 >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 msgr2=0x7f8b0406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 --2- 172.21.15.155:0/2219065678 >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 0x7f8b0406ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 -- 172.21.15.155:0/2219065678 >> v1:172.21.15.189:6789/0 conn(0x7f8b04155e50 legacy=0x7f8b040a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 -- 172.21.15.155:0/2219065678 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040af000 con 0x7f8b04156220 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b03fff700 1 --2- 172.21.15.155:0/2219065678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04156220 0x7f8b0406f120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b040aeae0 tx=0x7f8afc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794c5d5723d88676 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b02ffd700 1 -- 172.21.15.155:0/2219065678 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00e070 con 0x7f8b04156220 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b02ffd700 1 -- 172.21.15.155:0/2219065678 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00bb60 con 0x7f8b04156220 2024-08-17T02:27:26.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b02ffd700 1 -- 172.21.15.155:0/2219065678 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc012430 con 0x7f8b04156220 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- 172.21.15.155:0/2219065678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04156220 msgr2=0x7f8b0406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2219065678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04156220 0x7f8b0406f120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b040aeae0 tx=0x7f8afc009780 comp rx=0 tx=0).stop 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- 172.21.15.155:0/2219065678 shutdown_connections 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2219065678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04156220 0x7f8b0406f120 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2219065678 >> v2:172.21.15.155:3300/0 conn(0x7f8b040aa5f0 0x7f8b0406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- 172.21.15.155:0/2219065678 >> 172.21.15.155:0/2219065678 conn(0x7f8b04066e00 msgr2=0x7f8b04067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- 172.21.15.155:0/2219065678 shutdown_connections 2024-08-17T02:27:26.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.140+0000 7f8b09b75700 1 -- 172.21.15.155:0/2219065678 wait complete. 2024-08-17T02:27:26.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 Processor -- start 2024-08-17T02:27:26.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 -- start start 2024-08-17T02:27:26.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04155e50 0x7f8b04150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b04156220 0x7f8b040ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040975e0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04167830 con 0x7f8b04155e50 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b09b75700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04096cb0 con 0x7f8b04156220 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b037fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b037fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49980/0 (socket says 172.21.15.155:49980) 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b037fe700 1 -- 172.21.15.155:0/2712379273 learned_addr learned my addr 172.21.15.155:0/2712379273 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8afbfff700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04155e50 0x7f8b04150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.144+0000 7f8b03fff700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b04156220 0x7f8b040ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 -- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b04156220 msgr2=0x7f8b040ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b04156220 0x7f8b040ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 -- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04155e50 msgr2=0x7f8b04150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04155e50 0x7f8b04150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 -- 172.21.15.155:0/2712379273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009a20 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b037fe700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c790 tx=0x7f8af4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4011590 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4011710 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b04096f90 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4011ad0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04150e90 con 0x7f8b040aa5f0 2024-08-17T02:27:26.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b040645c0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8af401b3b0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 0x7f8ae4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afbfff700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 0x7f8ae4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.148+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8af407bf60 con 0x7f8b040aa5f0 2024-08-17T02:27:26.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.152+0000 7f8afbfff700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 0x7f8ae4062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b040cb6b0 tx=0x7f8aec009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.156+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8af404c3b0 con 0x7f8b040aa5f0 2024-08-17T02:27:26.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.316+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b04097720 con 0x7f8ae4060890 2024-08-17T02:27:26.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.332+0000 7f8afb7fe700 1 -- 172.21.15.155:0/2712379273 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253745 (secure 0 0 0) 0x7f8aec011a20 con 0x7f8ae4060890 2024-08-17T02:27:26.340 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 msgr2=0x7f8ae4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 0x7f8ae4062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b040cb6b0 tx=0x7f8aec009250 comp rx=0 tx=0).stop 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 msgr2=0x7f8b040c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c790 tx=0x7f8af4007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 shutdown_connections 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8ae4060890 0x7f8ae4062d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b04156220 0x7f8b040ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b04155e50 0x7f8b04150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 --2- 172.21.15.155:0/2712379273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b040aa5f0 0x7f8b040c7f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 >> 172.21.15.155:0/2712379273 conn(0x7f8b04066e00 msgr2=0x7f8b04152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 shutdown_connections 2024-08-17T02:27:26.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.336+0000 7f8b09b75700 1 -- 172.21.15.155:0/2712379273 wait complete. 2024-08-17T02:27:26.343 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:26.355 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:27:25.938479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385820,"kb_used_data":2496,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588900,"statfs":{"total":773094113280,"available":770651033600,"internally_reserved":0,"allocated":2555904,"data_stored":1598110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.281667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662087+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660861+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665359+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659190+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.669042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656739+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662064+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656958+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660141+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663934+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665397+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664015+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664259+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662000+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665845+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:27:19.368385+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:19.368385+0000","last_peered":"2024-08-17T02:27:19.368385+0000","last_clean":"2024-08-17T02:27:19.368385+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:19.368385+0000","last_undegraded":"2024-08-17T02:27:19.368385+0000","last_fullsized":"2024-08-17T02:27:19.368385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657872+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657485+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656804+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:59.950188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.658965+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663084+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657901+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661634+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657896+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664874+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:53.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661907+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664592+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:32:16.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659480+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664200+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664079+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662119+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664157+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":753664,"data_stored":638027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":757760,"data_stored":639038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.913}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-08-17T02:27:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-08-17T02:27:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-08-17T02:27:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-08-17T02:27:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.662087+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.660861+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.665359+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.659190+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.669042+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664042+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.656739+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-08-17T02:27:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.662064+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.656958+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.660141+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.663934+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.665397+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664015+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-08-17T02:27:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664259+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.662000+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-08-17T02:27:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.665845+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.657872+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.657485+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-08-17T02:27:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.656804+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:21:59.950188+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.658965+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.663084+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:27:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.657901+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.661634+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-08-17T02:27:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.657896+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664874+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:33:53.936272+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-08-17T02:27:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.661907+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664592+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:32:16.798044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.659480+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-08-17T02:27:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664200+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664079+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-08-17T02:27:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.662119+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:27:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-08-17T02:27:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:21.651045+0000', 'last_change': '2024-08-17T02:27:21.651045+0000', 'last_active': '2024-08-17T02:27:21.651045+0000', 'last_peered': '2024-08-17T02:27:21.651045+0000', 'last_clean': '2024-08-17T02:27:21.651045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:21.651045+0000', 'last_undegraded': '2024-08-17T02:27:21.651045+0000', 'last_fullsized': '2024-08-17T02:27:21.651045+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:21.651045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-08-17T02:27:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:20.642627+0000', 'last_change': '2024-08-17T02:27:20.664157+0000', 'last_active': '2024-08-17T02:27:20.642627+0000', 'last_peered': '2024-08-17T02:27:20.642627+0000', 'last_clean': '2024-08-17T02:27:20.642627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:20.642627+0000', 'last_undegraded': '2024-08-17T02:27:20.642627+0000', 'last_fullsized': '2024-08-17T02:27:20.642627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:20.642627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:27:26.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:27:26.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 Processor -- start 2024-08-17T02:27:26.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 -- start start 2024-08-17T02:27:26.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc40af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 0x7f9dc40a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc40b0270 con 0x7f9dc40a9260 2024-08-17T02:27:26.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40af660 con 0x7f9dc406e830 2024-08-17T02:27:26.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc9681700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40af940 con 0x7f9dc415d540 2024-08-17T02:27:26.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc27fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 0x7f9dc40a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc37fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9dc40a9260 0x7f9dc40b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49322/0 (socket says 172.21.15.155:49322) 2024-08-17T02:27:26.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc37fe700 1 -- 172.21.15.155:0/441223253 learned_addr learned my addr 172.21.15.155:0/441223253 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:26.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/441223253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/441223253 >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 msgr2=0x7f9dc40a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/441223253 >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 0x7f9dc40a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/441223253 >> v1:172.21.15.155:6789/0 conn(0x7f9dc40a9260 legacy=0x7f9dc40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc1ffb700 1 -- 172.21.15.155:0/441223253 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785350926 0 0) 0x7f9dc40b0270 con 0x7f9dc40a9260 2024-08-17T02:27:26.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/441223253 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40afc20 con 0x7f9dc415d540 2024-08-17T02:27:26.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc27fc700 1 --2- 172.21.15.155:0/441223253 >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 0x7f9dc40a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:26.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.480+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/441223253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc40af030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0098e0 tx=0x7f9dac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b7abb821f6f0d99 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc1ffb700 1 -- 172.21.15.155:0/441223253 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00b640 con 0x7f9dc415d540 2024-08-17T02:27:26.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc1ffb700 1 -- 172.21.15.155:0/441223253 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00b7a0 con 0x7f9dc415d540 2024-08-17T02:27:26.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc1ffb700 1 -- 172.21.15.155:0/441223253 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bb40 con 0x7f9dc415d540 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- 172.21.15.155:0/441223253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 msgr2=0x7f9dc40af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 --2- 172.21.15.155:0/441223253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc40af030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0098e0 tx=0x7f9dac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- 172.21.15.155:0/441223253 shutdown_connections 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 --2- 172.21.15.155:0/441223253 >> v2:172.21.15.155:3300/0 conn(0x7f9dc406e830 0x7f9dc40a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 --2- 172.21.15.155:0/441223253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc40af030 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- 172.21.15.155:0/441223253 >> 172.21.15.155:0/441223253 conn(0x7f9dc4066e00 msgr2=0x7f9dc4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- 172.21.15.155:0/441223253 shutdown_connections 2024-08-17T02:27:26.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- 172.21.15.155:0/441223253 wait complete. 2024-08-17T02:27:26.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 Processor -- start 2024-08-17T02:27:26.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.484+0000 7f9dc9681700 1 -- start start 2024-08-17T02:27:26.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 0x7f9dc4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc416dc00 con 0x7f9dc406e830 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40980a0 con 0x7f9dc40a9260 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc4098380 con 0x7f9dc415d540 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49992/0 (socket says 172.21.15.155:49992) 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/1475219144 learned_addr learned my addr 172.21.15.155:0/1475219144 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc37fe700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc27fc700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 0x7f9dc4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 msgr2=0x7f9dc4158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc4158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 msgr2=0x7f9dc4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 0x7f9dc4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 -- 172.21.15.155:0/1475219144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009a20 con 0x7f9dc406e830 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc27fc700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 0x7f9dc4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc2ffd700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0093f0 tx=0x7f9dac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bb20 con 0x7f9dc406e830 2024-08-17T02:27:26.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac011420 con 0x7f9dc406e830 2024-08-17T02:27:26.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac009420 con 0x7f9dc406e830 2024-08-17T02:27:26.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0117e0 con 0x7f9dc406e830 2024-08-17T02:27:26.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.488+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc4098940 con 0x7f9dc406e830 2024-08-17T02:27:26.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc416dd70 con 0x7f9dc406e830 2024-08-17T02:27:26.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9dac011c10 con 0x7f9dc406e830 2024-08-17T02:27:26.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dbaffd700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 0x7f9da4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dc27fc700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 0x7f9da4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9dac07e340 con 0x7f9dc406e830 2024-08-17T02:27:26.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.492+0000 7f9dc27fc700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 0x7f9da4062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9db40099f0 tx=0x7f9db400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.500+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9dac04e790 con 0x7f9dc406e830 2024-08-17T02:27:26.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.720+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9dc40645c0 con 0x7f9dc406e830 2024-08-17T02:27:26.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.724+0000 7f9dbaffd700 1 -- 172.21.15.155:0/1475219144 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f9dac051db0 con 0x7f9dc406e830 2024-08-17T02:27:26.727 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:26.728 INFO:teuthology.orchestra.run.smithi155.stdout:{"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861635,"num_in_osds":8,"osd_in_since":1723861627,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2443079680,"bytes_avail":770651033600,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4276}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-17T02:27:05.681028+0000","services":{}},"progress_events":{}} 2024-08-17T02:27:26.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 msgr2=0x7f9da4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 0x7f9da4062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9db40099f0 tx=0x7f9db400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:26.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 msgr2=0x7f9dc415c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0093f0 tx=0x7f9dac017000 comp rx=0 tx=0).stop 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 shutdown_connections 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9da4060860 0x7f9da4062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9dc415d540 0x7f9dc4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc40a9260 0x7f9dc4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 --2- 172.21.15.155:0/1475219144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dc406e830 0x7f9dc415c020 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 >> 172.21.15.155:0/1475219144 conn(0x7f9dc4066e00 msgr2=0x7f9dc406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 shutdown_connections 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.728+0000 7f9dc9681700 1 -- 172.21.15.155:0/1475219144 wait complete. 2024-08-17T02:27:26.741 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:27:26.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:26.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.840+0000 7f0e01ed2700 1 Processor -- start 2024-08-17T02:27:26.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.840+0000 7f0e01ed2700 1 -- start start 2024-08-17T02:27:26.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc155c00 con 0x7f0dfc0686a0 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc155e30 con 0x7f0dfc1557b0 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc156110 con 0x7f0dfc1553e0 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e016d1700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0dfc0686a0 0x7f0dfc0abf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49328/0 (socket says 172.21.15.155:49328) 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50002/0 (socket says 172.21.15.155:50002) 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e016d1700 1 -- 172.21.15.155:0/2671801076 learned_addr learned my addr 172.21.15.155:0/2671801076 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 -- 172.21.15.155:0/2671801076 >> v1:172.21.15.189:6789/0 conn(0x7f0dfc1557b0 legacy=0x7f0dfc0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 -- 172.21.15.155:0/2671801076 >> v1:172.21.15.155:6789/0 conn(0x7f0dfc0686a0 legacy=0x7f0dfc0abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 -- 172.21.15.155:0/2671801076 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc1563f0 con 0x7f0dfc1553e0 2024-08-17T02:27:26.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e00ed0700 1 --2- 172.21.15.155:0/2671801076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0098e0 tx=0x7f0dec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bdfab8e239e903 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0dfb7fe700 1 -- 172.21.15.155:0/2671801076 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec009e80 con 0x7f0dfc1553e0 2024-08-17T02:27:26.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0dfb7fe700 1 -- 172.21.15.155:0/2671801076 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00b860 con 0x7f0dfc1553e0 2024-08-17T02:27:26.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0dfb7fe700 1 -- 172.21.15.155:0/2671801076 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00bbe0 con 0x7f0dfc1553e0 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- 172.21.15.155:0/2671801076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc1553e0 msgr2=0x7f0dfc0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/2671801076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0098e0 tx=0x7f0dec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- 172.21.15.155:0/2671801076 shutdown_connections 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/2671801076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc1553e0 0x7f0dfc0af4d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- 172.21.15.155:0/2671801076 >> 172.21.15.155:0/2671801076 conn(0x7f0dfc06d800 msgr2=0x7f0dfc06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- 172.21.15.155:0/2671801076 shutdown_connections 2024-08-17T02:27:26.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.844+0000 7f0e01ed2700 1 -- 172.21.15.155:0/2671801076 wait complete. 2024-08-17T02:27:26.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 Processor -- start 2024-08-17T02:27:26.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 -- start start 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0dfc1553e0 0x7f0dfc069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 0x7f0dfc069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc168050 con 0x7f0dfc0686a0 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc15d080 con 0x7f0dfc1557b0 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e01ed2700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1683a0 con 0x7f0dfc1553e0 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50016/0 (socket says 172.21.15.155:50016) 2024-08-17T02:27:26.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 -- 172.21.15.155:0/1203359470 learned_addr learned my addr 172.21.15.155:0/1203359470 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0dfbfff700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0dfc1553e0 0x7f0dfc069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e016d1700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 0x7f0dfc069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 -- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0dfc1553e0 msgr2=0x7f0dfc069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0dfc1553e0 0x7f0dfc069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 -- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 msgr2=0x7f0dfc069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 0x7f0dfc069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e00ed0700 1 -- 172.21.15.155:0/1203359470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec009420 con 0x7f0dfc0686a0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.848+0000 7f0e016d1700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 0x7f0dfc069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0e00ed0700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc069650 tx=0x7f0dec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00bbe0 con 0x7f0dfc0686a0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec011420 con 0x7f0dfc0686a0 2024-08-17T02:27:26.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc168680 con 0x7f0dfc0686a0 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0117e0 con 0x7f0dfc0686a0 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc15d360 con 0x7f0dfc0686a0 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc168b80 con 0x7f0dfc0686a0 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0dec011bd0 con 0x7f0dfc0686a0 2024-08-17T02:27:26.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 0x7f0de8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0dec07e280 con 0x7f0dfc0686a0 2024-08-17T02:27:26.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.852+0000 7f0dfbfff700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 0x7f0de8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.856+0000 7f0dfbfff700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 0x7f0de8062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0afc50 tx=0x7f0df0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:26.860+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0dec04e750 con 0x7f0dfc0686a0 2024-08-17T02:27:27.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.016+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dfc0638f0 con 0x7f0de8060860 2024-08-17T02:27:27.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.032+0000 7f0df8ff9700 1 -- 172.21.15.155:0/1203359470 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253745 (secure 0 0 0) 0x7f0dfc0638f0 con 0x7f0de8060860 2024-08-17T02:27:27.039 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 msgr2=0x7f0de8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 0x7f0de8062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0afc50 tx=0x7f0df0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 msgr2=0x7f0dfc167b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc069650 tx=0x7f0dec017000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 shutdown_connections 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0de8060860 0x7f0de8062d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dfc1557b0 0x7f0dfc069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0dfc1553e0 0x7f0dfc069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 --2- 172.21.15.155:0/1203359470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dfc0686a0 0x7f0dfc167b10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.036+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 >> 172.21.15.155:0/1203359470 conn(0x7f0dfc06d800 msgr2=0x7f0dfc0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.040+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 shutdown_connections 2024-08-17T02:27:27.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:27.040+0000 7f0e01ed2700 1 -- 172.21.15.155:0/1203359470 wait complete. 2024-08-17T02:27:27.045 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:27.055 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:27:25.938479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385820,"kb_used_data":2496,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588900,"statfs":{"total":773094113280,"available":770651033600,"internally_reserved":0,"allocated":2555904,"data_stored":1598110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.281667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662087+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660861+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665359+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659190+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.669042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664042+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656739+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662064+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656958+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.660141+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663934+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:41.558156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665397+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664015+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664259+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662000+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.665845+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:27:19.368385+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:19.368385+0000","last_peered":"2024-08-17T02:27:19.368385+0000","last_clean":"2024-08-17T02:27:19.368385+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:19.368385+0000","last_undegraded":"2024-08-17T02:27:19.368385+0000","last_fullsized":"2024-08-17T02:27:19.368385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657872+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657485+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.656804+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:59.950188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.658965+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.663084+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657901+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661634+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.657896+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664874+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:53.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.661907+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664592+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:32:16.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.659480+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664200+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664079+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:27.894525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.662119+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:00:41.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:21.651045+0000","last_change":"2024-08-17T02:27:21.651045+0000","last_active":"2024-08-17T02:27:21.651045+0000","last_peered":"2024-08-17T02:27:21.651045+0000","last_clean":"2024-08-17T02:27:21.651045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:21.651045+0000","last_undegraded":"2024-08-17T02:27:21.651045+0000","last_fullsized":"2024-08-17T02:27:21.651045+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:20.642627+0000","last_change":"2024-08-17T02:27:20.664157+0000","last_active":"2024-08-17T02:27:20.642627+0000","last_peered":"2024-08-17T02:27:20.642627+0000","last_clean":"2024-08-17T02:27:20.642627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:20.642627+0000","last_undegraded":"2024-08-17T02:27:20.642627+0000","last_fullsized":"2024-08-17T02:27:20.642627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":753664,"data_stored":638027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":757760,"data_stored":639038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.913}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:30.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:30.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 Processor -- start 2024-08-17T02:27:30.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- start start 2024-08-17T02:27:30.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62600688d0 0x7f6260068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 0x7f62600caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 0x7f626006a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600cb220 con 0x7f62600688d0 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600c7750 con 0x7f6260066e00 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600caf80 con 0x7f62600cc160 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62600688d0 0x7f6260068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62600688d0 0x7f6260068ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50032/0 (socket says 172.21.15.155:50032) 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 -- 172.21.15.155:0/2651693921 learned_addr learned my addr 172.21.15.155:0/2651693921 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:30.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625ffff700 1 --2- 172.21.15.155:0/2651693921 >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 0x7f626006a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 -- 172.21.15.155:0/2651693921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 msgr2=0x7f62600caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625effd700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 0x7f62600caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 0x7f62600caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 -- 172.21.15.155:0/2651693921 >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 msgr2=0x7f626006a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 --2- 172.21.15.155:0/2651693921 >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 0x7f626006a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 -- 172.21.15.155:0/2651693921 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600c6e20 con 0x7f62600688d0 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625effd700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 0x7f62600caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625ffff700 1 --2- 172.21.15.155:0/2651693921 >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 0x7f626006a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:30.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625f7fe700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62600688d0 0x7f6260068ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62600abb10 tx=0x7f6254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad5bc0841022824 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625e7fc700 1 -- 172.21.15.155:0/2651693921 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400b860 con 0x7f62600688d0 2024-08-17T02:27:30.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625e7fc700 1 -- 172.21.15.155:0/2651693921 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625400b9c0 con 0x7f62600688d0 2024-08-17T02:27:30.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f625e7fc700 1 -- 172.21.15.155:0/2651693921 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400bd60 con 0x7f62600688d0 2024-08-17T02:27:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- 172.21.15.155:0/2651693921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62600688d0 msgr2=0x7f6260068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62600688d0 0x7f6260068ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62600abb10 tx=0x7f6254009250 comp rx=0 tx=0).stop 2024-08-17T02:27:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- 172.21.15.155:0/2651693921 shutdown_connections 2024-08-17T02:27:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- 172.21.15.155:0/2651693921 >> v2:172.21.15.189:3300/0 conn(0x7f6260066e00 0x7f626006a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600cc160 0x7f62600caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 --2- 172.21.15.155:0/2651693921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62600688d0 0x7f6260068ca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- 172.21.15.155:0/2651693921 >> 172.21.15.155:0/2651693921 conn(0x7f62600c9c20 msgr2=0x7f626006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- 172.21.15.155:0/2651693921 shutdown_connections 2024-08-17T02:27:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.176+0000 7f6266234700 1 -- 172.21.15.155:0/2651693921 wait complete. 2024-08-17T02:27:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 Processor -- start 2024-08-17T02:27:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 -- start start 2024-08-17T02:27:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 0x7f6260165d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 0x7f62600c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c3bd0 con 0x7f6260066e00 2024-08-17T02:27:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c3eb0 con 0x7f62600cc160 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f6266234700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c4190 con 0x7f62600688d0 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.180+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50046/0 (socket says 172.21.15.155:50046) 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 -- 172.21.15.155:0/538113726 learned_addr learned my addr 172.21.15.155:0/538113726 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625effd700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 0x7f6260165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625ffff700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 0x7f62600c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 -- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 msgr2=0x7f6260165d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 0x7f6260165d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 -- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 msgr2=0x7f62600c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 0x7f62600c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 -- 172.21.15.155:0/538113726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540094f0 con 0x7f6260066e00 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625ffff700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 0x7f62600c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625effd700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 0x7f6260165d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:30.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f625f7fe700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62600c36a0 tx=0x7f6254017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254024440 con 0x7f6260066e00 2024-08-17T02:27:30.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540245a0 con 0x7f6260066e00 2024-08-17T02:27:30.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62600c4470 con 0x7f6260066e00 2024-08-17T02:27:30.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254024960 con 0x7f6260066e00 2024-08-17T02:27:30.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6260165030 con 0x7f6260066e00 2024-08-17T02:27:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.184+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62600c4970 con 0x7f6260066e00 2024-08-17T02:27:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.188+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f625401a420 con 0x7f6260066e00 2024-08-17T02:27:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.188+0000 7f62477fe700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 0x7f624c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.188+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f625407ea60 con 0x7f6260066e00 2024-08-17T02:27:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.188+0000 7f625effd700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 0x7f624c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.188+0000 7f625effd700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 0x7f624c062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f626006ea40 tx=0x7f62580077a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.196+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f625404eeb0 con 0x7f6260066e00 2024-08-17T02:27:30.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.356+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62600645c0 con 0x7f624c060860 2024-08-17T02:27:30.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.372+0000 7f62477fe700 1 -- 172.21.15.155:0/538113726 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264536 (secure 0 0 0) 0x7f62600645c0 con 0x7f624c060860 2024-08-17T02:27:30.379 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:30.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 msgr2=0x7f624c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 0x7f624c062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f626006ea40 tx=0x7f62580077a0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 msgr2=0x7f6260164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62600c36a0 tx=0x7f6254017000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 shutdown_connections 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f624c060860 0x7f624c062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62600cc160 0x7f62600c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f62600688d0 0x7f6260165d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 --2- 172.21.15.155:0/538113726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6260066e00 0x7f6260164af0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 >> 172.21.15.155:0/538113726 conn(0x7f62600c9c20 msgr2=0x7f62600c7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 shutdown_connections 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.380+0000 7f6266234700 1 -- 172.21.15.155:0/538113726 wait complete. 2024-08-17T02:27:30.383 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:30.395 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:27:29.939911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385904,"kb_used_data":2884,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588816,"statfs":{"total":773094113280,"available":770650947584,"internally_reserved":0,"allocated":2953216,"data_stored":1774713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714539+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.714539+0000","last_peered":"2024-08-17T02:27:22.714539+0000","last_clean":"2024-08-17T02:27:22.714539+0000","last_became_active":"2024-08-17T02:27:22.709948+0000","last_became_peered":"2024-08-17T02:27:22.709948+0000","last_unstale":"2024-08-17T02:27:22.714539+0000","last_undegraded":"2024-08-17T02:27:22.714539+0000","last_fullsized":"2024-08-17T02:27:22.714539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:31.256882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718042+0000","last_change":"2024-08-17T02:27:22.713233+0000","last_active":"2024-08-17T02:27:22.718042+0000","last_peered":"2024-08-17T02:27:22.718042+0000","last_clean":"2024-08-17T02:27:22.718042+0000","last_became_active":"2024-08-17T02:27:22.712342+0000","last_became_peered":"2024-08-17T02:27:22.712342+0000","last_unstale":"2024-08-17T02:27:22.718042+0000","last_undegraded":"2024-08-17T02:27:22.718042+0000","last_fullsized":"2024-08-17T02:27:22.718042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:47.644721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724729+0000","last_change":"2024-08-17T02:27:22.720583+0000","last_active":"2024-08-17T02:27:22.724729+0000","last_peered":"2024-08-17T02:27:22.724729+0000","last_clean":"2024-08-17T02:27:22.724729+0000","last_became_active":"2024-08-17T02:27:22.720240+0000","last_became_peered":"2024-08-17T02:27:22.720240+0000","last_unstale":"2024-08-17T02:27:22.724729+0000","last_undegraded":"2024-08-17T02:27:22.724729+0000","last_fullsized":"2024-08-17T02:27:22.724729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716830+0000","last_change":"2024-08-17T02:27:22.715254+0000","last_active":"2024-08-17T02:27:22.716830+0000","last_peered":"2024-08-17T02:27:22.716830+0000","last_clean":"2024-08-17T02:27:22.716830+0000","last_became_active":"2024-08-17T02:27:22.714973+0000","last_became_peered":"2024-08-17T02:27:22.714973+0000","last_unstale":"2024-08-17T02:27:22.716830+0000","last_undegraded":"2024-08-17T02:27:22.716830+0000","last_fullsized":"2024-08-17T02:27:22.716830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:28.901609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722056+0000","last_change":"2024-08-17T02:27:22.718174+0000","last_active":"2024-08-17T02:27:22.722056+0000","last_peered":"2024-08-17T02:27:22.722056+0000","last_clean":"2024-08-17T02:27:22.722056+0000","last_became_active":"2024-08-17T02:27:22.715180+0000","last_became_peered":"2024-08-17T02:27:22.715180+0000","last_unstale":"2024-08-17T02:27:22.722056+0000","last_undegraded":"2024-08-17T02:27:22.722056+0000","last_fullsized":"2024-08-17T02:27:22.722056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:33:00.741989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714252+0000","last_change":"2024-08-17T02:27:22.713445+0000","last_active":"2024-08-17T02:27:22.714252+0000","last_peered":"2024-08-17T02:27:22.714252+0000","last_clean":"2024-08-17T02:27:22.714252+0000","last_became_active":"2024-08-17T02:27:22.713175+0000","last_became_peered":"2024-08-17T02:27:22.713175+0000","last_unstale":"2024-08-17T02:27:22.714252+0000","last_undegraded":"2024-08-17T02:27:22.714252+0000","last_fullsized":"2024-08-17T02:27:22.714252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:54.337887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722435+0000","last_change":"2024-08-17T02:27:22.719534+0000","last_active":"2024-08-17T02:27:22.722435+0000","last_peered":"2024-08-17T02:27:22.722435+0000","last_clean":"2024-08-17T02:27:22.722435+0000","last_became_active":"2024-08-17T02:27:22.719271+0000","last_became_peered":"2024-08-17T02:27:22.719271+0000","last_unstale":"2024-08-17T02:27:22.722435+0000","last_undegraded":"2024-08-17T02:27:22.722435+0000","last_fullsized":"2024-08-17T02:27:22.722435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:17.620613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724689+0000","last_change":"2024-08-17T02:27:22.719409+0000","last_active":"2024-08-17T02:27:22.724689+0000","last_peered":"2024-08-17T02:27:22.724689+0000","last_clean":"2024-08-17T02:27:22.724689+0000","last_became_active":"2024-08-17T02:27:22.718966+0000","last_became_peered":"2024-08-17T02:27:22.718966+0000","last_unstale":"2024-08-17T02:27:22.724689+0000","last_undegraded":"2024-08-17T02:27:22.724689+0000","last_fullsized":"2024-08-17T02:27:22.724689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:12.695037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711289+0000","last_change":"2024-08-17T02:27:22.708900+0000","last_active":"2024-08-17T02:27:22.711289+0000","last_peered":"2024-08-17T02:27:22.711289+0000","last_clean":"2024-08-17T02:27:22.711289+0000","last_became_active":"2024-08-17T02:27:22.708639+0000","last_became_peered":"2024-08-17T02:27:22.708639+0000","last_unstale":"2024-08-17T02:27:22.711289+0000","last_undegraded":"2024-08-17T02:27:22.711289+0000","last_fullsized":"2024-08-17T02:27:22.711289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:28.298093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722437+0000","last_change":"2024-08-17T02:27:22.718947+0000","last_active":"2024-08-17T02:27:22.722437+0000","last_peered":"2024-08-17T02:27:22.722437+0000","last_clean":"2024-08-17T02:27:22.722437+0000","last_became_active":"2024-08-17T02:27:22.718468+0000","last_became_peered":"2024-08-17T02:27:22.718468+0000","last_unstale":"2024-08-17T02:27:22.722437+0000","last_undegraded":"2024-08-17T02:27:22.722437+0000","last_fullsized":"2024-08-17T02:27:22.722437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:33.020825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721960+0000","last_change":"2024-08-17T02:27:22.714887+0000","last_active":"2024-08-17T02:27:22.721960+0000","last_peered":"2024-08-17T02:27:22.721960+0000","last_clean":"2024-08-17T02:27:22.721960+0000","last_became_active":"2024-08-17T02:27:22.714523+0000","last_became_peered":"2024-08-17T02:27:22.714523+0000","last_unstale":"2024-08-17T02:27:22.721960+0000","last_undegraded":"2024-08-17T02:27:22.721960+0000","last_fullsized":"2024-08-17T02:27:22.721960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:06:07.993888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714583+0000","last_change":"2024-08-17T02:27:22.705954+0000","last_active":"2024-08-17T02:27:22.714583+0000","last_peered":"2024-08-17T02:27:22.714583+0000","last_clean":"2024-08-17T02:27:22.714583+0000","last_became_active":"2024-08-17T02:27:22.705129+0000","last_became_peered":"2024-08-17T02:27:22.705129+0000","last_unstale":"2024-08-17T02:27:22.714583+0000","last_undegraded":"2024-08-17T02:27:22.714583+0000","last_fullsized":"2024-08-17T02:27:22.714583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:36.875628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713100+0000","last_change":"2024-08-17T02:27:22.711703+0000","last_active":"2024-08-17T02:27:22.713100+0000","last_peered":"2024-08-17T02:27:22.713100+0000","last_clean":"2024-08-17T02:27:22.713100+0000","last_became_active":"2024-08-17T02:27:22.711350+0000","last_became_peered":"2024-08-17T02:27:22.711350+0000","last_unstale":"2024-08-17T02:27:22.713100+0000","last_undegraded":"2024-08-17T02:27:22.713100+0000","last_fullsized":"2024-08-17T02:27:22.713100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:28.003477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707981+0000","last_change":"2024-08-17T02:27:22.702614+0000","last_active":"2024-08-17T02:27:22.707981+0000","last_peered":"2024-08-17T02:27:22.707981+0000","last_clean":"2024-08-17T02:27:22.707981+0000","last_became_active":"2024-08-17T02:27:22.702337+0000","last_became_peered":"2024-08-17T02:27:22.702337+0000","last_unstale":"2024-08-17T02:27:22.707981+0000","last_undegraded":"2024-08-17T02:27:22.707981+0000","last_fullsized":"2024-08-17T02:27:22.707981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:07:22.333869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719804+0000","last_change":"2024-08-17T02:27:22.716233+0000","last_active":"2024-08-17T02:27:22.719804+0000","last_peered":"2024-08-17T02:27:22.719804+0000","last_clean":"2024-08-17T02:27:22.719804+0000","last_became_active":"2024-08-17T02:27:22.715931+0000","last_became_peered":"2024-08-17T02:27:22.715931+0000","last_unstale":"2024-08-17T02:27:22.719804+0000","last_undegraded":"2024-08-17T02:27:22.719804+0000","last_fullsized":"2024-08-17T02:27:22.719804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709764+0000","last_change":"2024-08-17T02:27:22.706621+0000","last_active":"2024-08-17T02:27:22.709764+0000","last_peered":"2024-08-17T02:27:22.709764+0000","last_clean":"2024-08-17T02:27:22.709764+0000","last_became_active":"2024-08-17T02:27:22.705085+0000","last_became_peered":"2024-08-17T02:27:22.705085+0000","last_unstale":"2024-08-17T02:27:22.709764+0000","last_undegraded":"2024-08-17T02:27:22.709764+0000","last_fullsized":"2024-08-17T02:27:22.709764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:05.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711957+0000","last_change":"2024-08-17T02:27:22.707866+0000","last_active":"2024-08-17T02:27:22.711957+0000","last_peered":"2024-08-17T02:27:22.711957+0000","last_clean":"2024-08-17T02:27:22.711957+0000","last_became_active":"2024-08-17T02:27:22.707509+0000","last_became_peered":"2024-08-17T02:27:22.707509+0000","last_unstale":"2024-08-17T02:27:22.711957+0000","last_undegraded":"2024-08-17T02:27:22.711957+0000","last_fullsized":"2024-08-17T02:27:22.711957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:50.650639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.701747+0000","last_change":"2024-08-17T02:27:22.692819+0000","last_active":"2024-08-17T02:27:22.701747+0000","last_peered":"2024-08-17T02:27:22.701747+0000","last_clean":"2024-08-17T02:27:22.701747+0000","last_became_active":"2024-08-17T02:27:22.692445+0000","last_became_peered":"2024-08-17T02:27:22.692445+0000","last_unstale":"2024-08-17T02:27:22.701747+0000","last_undegraded":"2024-08-17T02:27:22.701747+0000","last_fullsized":"2024-08-17T02:27:22.701747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714077+0000","last_change":"2024-08-17T02:27:22.713391+0000","last_active":"2024-08-17T02:27:22.714077+0000","last_peered":"2024-08-17T02:27:22.714077+0000","last_clean":"2024-08-17T02:27:22.714077+0000","last_became_active":"2024-08-17T02:27:22.713117+0000","last_became_peered":"2024-08-17T02:27:22.713117+0000","last_unstale":"2024-08-17T02:27:22.714077+0000","last_undegraded":"2024-08-17T02:27:22.714077+0000","last_fullsized":"2024-08-17T02:27:22.714077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:23.685025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714600+0000","last_change":"2024-08-17T02:27:22.706145+0000","last_active":"2024-08-17T02:27:22.714600+0000","last_peered":"2024-08-17T02:27:22.714600+0000","last_clean":"2024-08-17T02:27:22.714600+0000","last_became_active":"2024-08-17T02:27:22.705632+0000","last_became_peered":"2024-08-17T02:27:22.705632+0000","last_unstale":"2024-08-17T02:27:22.714600+0000","last_undegraded":"2024-08-17T02:27:22.714600+0000","last_fullsized":"2024-08-17T02:27:22.714600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.808731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719617+0000","last_change":"2024-08-17T02:27:22.713685+0000","last_active":"2024-08-17T02:27:22.719617+0000","last_peered":"2024-08-17T02:27:22.719617+0000","last_clean":"2024-08-17T02:27:22.719617+0000","last_became_active":"2024-08-17T02:27:22.713406+0000","last_became_peered":"2024-08-17T02:27:22.713406+0000","last_unstale":"2024-08-17T02:27:22.719617+0000","last_undegraded":"2024-08-17T02:27:22.719617+0000","last_fullsized":"2024-08-17T02:27:22.719617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712608+0000","last_change":"2024-08-17T02:27:22.711278+0000","last_active":"2024-08-17T02:27:22.712608+0000","last_peered":"2024-08-17T02:27:22.712608+0000","last_clean":"2024-08-17T02:27:22.712608+0000","last_became_active":"2024-08-17T02:27:22.710945+0000","last_became_peered":"2024-08-17T02:27:22.710945+0000","last_unstale":"2024-08-17T02:27:22.712608+0000","last_undegraded":"2024-08-17T02:27:22.712608+0000","last_fullsized":"2024-08-17T02:27:22.712608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719769+0000","last_change":"2024-08-17T02:27:22.716220+0000","last_active":"2024-08-17T02:27:22.719769+0000","last_peered":"2024-08-17T02:27:22.719769+0000","last_clean":"2024-08-17T02:27:22.719769+0000","last_became_active":"2024-08-17T02:27:22.714375+0000","last_became_peered":"2024-08-17T02:27:22.714375+0000","last_unstale":"2024-08-17T02:27:22.719769+0000","last_undegraded":"2024-08-17T02:27:22.719769+0000","last_fullsized":"2024-08-17T02:27:22.719769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:51.976961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717283+0000","last_change":"2024-08-17T02:27:22.716173+0000","last_active":"2024-08-17T02:27:22.717283+0000","last_peered":"2024-08-17T02:27:22.717283+0000","last_clean":"2024-08-17T02:27:22.717283+0000","last_became_active":"2024-08-17T02:27:22.715892+0000","last_became_peered":"2024-08-17T02:27:22.715892+0000","last_unstale":"2024-08-17T02:27:22.717283+0000","last_undegraded":"2024-08-17T02:27:22.717283+0000","last_fullsized":"2024-08-17T02:27:22.717283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:02.262851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719843+0000","last_change":"2024-08-17T02:27:22.716737+0000","last_active":"2024-08-17T02:27:22.719843+0000","last_peered":"2024-08-17T02:27:22.719843+0000","last_clean":"2024-08-17T02:27:22.719843+0000","last_became_active":"2024-08-17T02:27:22.715984+0000","last_became_peered":"2024-08-17T02:27:22.715984+0000","last_unstale":"2024-08-17T02:27:22.719843+0000","last_undegraded":"2024-08-17T02:27:22.719843+0000","last_fullsized":"2024-08-17T02:27:22.719843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:02.516802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712777+0000","last_change":"2024-08-17T02:27:22.708044+0000","last_active":"2024-08-17T02:27:22.712777+0000","last_peered":"2024-08-17T02:27:22.712777+0000","last_clean":"2024-08-17T02:27:22.712777+0000","last_became_active":"2024-08-17T02:27:22.707573+0000","last_became_peered":"2024-08-17T02:27:22.707573+0000","last_unstale":"2024-08-17T02:27:22.712777+0000","last_undegraded":"2024-08-17T02:27:22.712777+0000","last_fullsized":"2024-08-17T02:27:22.712777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:48.395371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707359+0000","last_change":"2024-08-17T02:27:22.703317+0000","last_active":"2024-08-17T02:27:22.707359+0000","last_peered":"2024-08-17T02:27:22.707359+0000","last_clean":"2024-08-17T02:27:22.707359+0000","last_became_active":"2024-08-17T02:27:22.703015+0000","last_became_peered":"2024-08-17T02:27:22.703015+0000","last_unstale":"2024-08-17T02:27:22.707359+0000","last_undegraded":"2024-08-17T02:27:22.707359+0000","last_fullsized":"2024-08-17T02:27:22.707359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719147+0000","last_change":"2024-08-17T02:27:22.715163+0000","last_active":"2024-08-17T02:27:22.719147+0000","last_peered":"2024-08-17T02:27:22.719147+0000","last_clean":"2024-08-17T02:27:22.719147+0000","last_became_active":"2024-08-17T02:27:22.714822+0000","last_became_peered":"2024-08-17T02:27:22.714822+0000","last_unstale":"2024-08-17T02:27:22.719147+0000","last_undegraded":"2024-08-17T02:27:22.719147+0000","last_fullsized":"2024-08-17T02:27:22.719147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:16.375853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713814+0000","last_change":"2024-08-17T02:27:22.708377+0000","last_active":"2024-08-17T02:27:22.713814+0000","last_peered":"2024-08-17T02:27:22.713814+0000","last_clean":"2024-08-17T02:27:22.713814+0000","last_became_active":"2024-08-17T02:27:22.708110+0000","last_became_peered":"2024-08-17T02:27:22.708110+0000","last_unstale":"2024-08-17T02:27:22.713814+0000","last_undegraded":"2024-08-17T02:27:22.713814+0000","last_fullsized":"2024-08-17T02:27:22.713814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:00.145322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717346+0000","last_change":"2024-08-17T02:27:22.716325+0000","last_active":"2024-08-17T02:27:22.717346+0000","last_peered":"2024-08-17T02:27:22.717346+0000","last_clean":"2024-08-17T02:27:22.717346+0000","last_became_active":"2024-08-17T02:27:22.715973+0000","last_became_peered":"2024-08-17T02:27:22.715973+0000","last_unstale":"2024-08-17T02:27:22.717346+0000","last_undegraded":"2024-08-17T02:27:22.717346+0000","last_fullsized":"2024-08-17T02:27:22.717346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:10.581368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706793+0000","last_change":"2024-08-17T02:27:22.702498+0000","last_active":"2024-08-17T02:27:22.706793+0000","last_peered":"2024-08-17T02:27:22.706793+0000","last_clean":"2024-08-17T02:27:22.706793+0000","last_became_active":"2024-08-17T02:27:22.702167+0000","last_became_peered":"2024-08-17T02:27:22.702167+0000","last_unstale":"2024-08-17T02:27:22.706793+0000","last_undegraded":"2024-08-17T02:27:22.706793+0000","last_fullsized":"2024-08-17T02:27:22.706793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:04.036357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709416+0000","last_change":"2024-08-17T02:27:22.704139+0000","last_active":"2024-08-17T02:27:22.709416+0000","last_peered":"2024-08-17T02:27:22.709416+0000","last_clean":"2024-08-17T02:27:22.709416+0000","last_became_active":"2024-08-17T02:27:22.703169+0000","last_became_peered":"2024-08-17T02:27:22.703169+0000","last_unstale":"2024-08-17T02:27:22.709416+0000","last_undegraded":"2024-08-17T02:27:22.709416+0000","last_fullsized":"2024-08-17T02:27:22.709416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716771+0000","last_change":"2024-08-17T02:27:22.715481+0000","last_active":"2024-08-17T02:27:22.716771+0000","last_peered":"2024-08-17T02:27:22.716771+0000","last_clean":"2024-08-17T02:27:22.716771+0000","last_became_active":"2024-08-17T02:27:22.715124+0000","last_became_peered":"2024-08-17T02:27:22.715124+0000","last_unstale":"2024-08-17T02:27:22.716771+0000","last_undegraded":"2024-08-17T02:27:22.716771+0000","last_fullsized":"2024-08-17T02:27:22.716771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715671+0000","last_change":"2024-08-17T02:27:21.681341+0000","last_active":"2024-08-17T02:27:22.715671+0000","last_peered":"2024-08-17T02:27:22.715671+0000","last_clean":"2024-08-17T02:27:22.715671+0000","last_became_active":"2024-08-17T02:27:21.681038+0000","last_became_peered":"2024-08-17T02:27:21.681038+0000","last_unstale":"2024-08-17T02:27:22.715671+0000","last_undegraded":"2024-08-17T02:27:22.715671+0000","last_fullsized":"2024-08-17T02:27:22.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.723868+0000","last_change":"2024-08-17T02:27:22.722197+0000","last_active":"2024-08-17T02:27:22.723868+0000","last_peered":"2024-08-17T02:27:22.723868+0000","last_clean":"2024-08-17T02:27:22.723868+0000","last_became_active":"2024-08-17T02:27:22.721882+0000","last_became_peered":"2024-08-17T02:27:22.721882+0000","last_unstale":"2024-08-17T02:27:22.723868+0000","last_undegraded":"2024-08-17T02:27:22.723868+0000","last_fullsized":"2024-08-17T02:27:22.723868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712031+0000","last_change":"2024-08-17T02:27:21.681865+0000","last_active":"2024-08-17T02:27:22.712031+0000","last_peered":"2024-08-17T02:27:22.712031+0000","last_clean":"2024-08-17T02:27:22.712031+0000","last_became_active":"2024-08-17T02:27:21.681071+0000","last_became_peered":"2024-08-17T02:27:21.681071+0000","last_unstale":"2024-08-17T02:27:22.712031+0000","last_undegraded":"2024-08-17T02:27:22.712031+0000","last_fullsized":"2024-08-17T02:27:22.712031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:47.386952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694890+0000","last_change":"2024-08-17T02:27:21.681027+0000","last_active":"2024-08-17T02:27:22.694890+0000","last_peered":"2024-08-17T02:27:22.694890+0000","last_clean":"2024-08-17T02:27:22.694890+0000","last_became_active":"2024-08-17T02:27:21.680738+0000","last_became_peered":"2024-08-17T02:27:21.680738+0000","last_unstale":"2024-08-17T02:27:22.694890+0000","last_undegraded":"2024-08-17T02:27:22.694890+0000","last_fullsized":"2024-08-17T02:27:22.694890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716007+0000","last_change":"2024-08-17T02:27:22.711080+0000","last_active":"2024-08-17T02:27:22.716007+0000","last_peered":"2024-08-17T02:27:22.716007+0000","last_clean":"2024-08-17T02:27:22.716007+0000","last_became_active":"2024-08-17T02:27:22.710758+0000","last_became_peered":"2024-08-17T02:27:22.710758+0000","last_unstale":"2024-08-17T02:27:22.716007+0000","last_undegraded":"2024-08-17T02:27:22.716007+0000","last_fullsized":"2024-08-17T02:27:22.716007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:23.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688653+0000","last_change":"2024-08-17T02:27:21.683107+0000","last_active":"2024-08-17T02:27:22.688653+0000","last_peered":"2024-08-17T02:27:22.688653+0000","last_clean":"2024-08-17T02:27:22.688653+0000","last_became_active":"2024-08-17T02:27:21.682425+0000","last_became_peered":"2024-08-17T02:27:21.682425+0000","last_unstale":"2024-08-17T02:27:22.688653+0000","last_undegraded":"2024-08-17T02:27:22.688653+0000","last_fullsized":"2024-08-17T02:27:22.688653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:44.884474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718332+0000","last_change":"2024-08-17T02:27:22.707768+0000","last_active":"2024-08-17T02:27:22.718332+0000","last_peered":"2024-08-17T02:27:22.718332+0000","last_clean":"2024-08-17T02:27:22.718332+0000","last_became_active":"2024-08-17T02:27:22.704583+0000","last_became_peered":"2024-08-17T02:27:22.704583+0000","last_unstale":"2024-08-17T02:27:22.718332+0000","last_undegraded":"2024-08-17T02:27:22.718332+0000","last_fullsized":"2024-08-17T02:27:22.718332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.697955+0000","last_change":"2024-08-17T02:27:21.675353+0000","last_active":"2024-08-17T02:27:22.697955+0000","last_peered":"2024-08-17T02:27:22.697955+0000","last_clean":"2024-08-17T02:27:22.697955+0000","last_became_active":"2024-08-17T02:27:21.675012+0000","last_became_peered":"2024-08-17T02:27:21.675012+0000","last_unstale":"2024-08-17T02:27:22.697955+0000","last_undegraded":"2024-08-17T02:27:22.697955+0000","last_fullsized":"2024-08-17T02:27:22.697955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712879+0000","last_change":"2024-08-17T02:27:22.709387+0000","last_active":"2024-08-17T02:27:22.712879+0000","last_peered":"2024-08-17T02:27:22.712879+0000","last_clean":"2024-08-17T02:27:22.712879+0000","last_became_active":"2024-08-17T02:27:22.708326+0000","last_became_peered":"2024-08-17T02:27:22.708326+0000","last_unstale":"2024-08-17T02:27:22.712879+0000","last_undegraded":"2024-08-17T02:27:22.712879+0000","last_fullsized":"2024-08-17T02:27:22.712879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:18.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702030+0000","last_change":"2024-08-17T02:27:21.683255+0000","last_active":"2024-08-17T02:27:22.702030+0000","last_peered":"2024-08-17T02:27:22.702030+0000","last_clean":"2024-08-17T02:27:22.702030+0000","last_became_active":"2024-08-17T02:27:21.682833+0000","last_became_peered":"2024-08-17T02:27:21.682833+0000","last_unstale":"2024-08-17T02:27:22.702030+0000","last_undegraded":"2024-08-17T02:27:22.702030+0000","last_fullsized":"2024-08-17T02:27:22.702030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:32.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713451+0000","last_change":"2024-08-17T02:27:22.707536+0000","last_active":"2024-08-17T02:27:22.713451+0000","last_peered":"2024-08-17T02:27:22.713451+0000","last_clean":"2024-08-17T02:27:22.713451+0000","last_became_active":"2024-08-17T02:27:22.705906+0000","last_became_peered":"2024-08-17T02:27:22.705906+0000","last_unstale":"2024-08-17T02:27:22.713451+0000","last_undegraded":"2024-08-17T02:27:22.713451+0000","last_fullsized":"2024-08-17T02:27:22.713451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.705771+0000","last_change":"2024-08-17T02:27:21.679646+0000","last_active":"2024-08-17T02:27:22.705771+0000","last_peered":"2024-08-17T02:27:22.705771+0000","last_clean":"2024-08-17T02:27:22.705771+0000","last_became_active":"2024-08-17T02:27:21.679295+0000","last_became_peered":"2024-08-17T02:27:21.679295+0000","last_unstale":"2024-08-17T02:27:22.705771+0000","last_undegraded":"2024-08-17T02:27:22.705771+0000","last_fullsized":"2024-08-17T02:27:22.705771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706909+0000","last_change":"2024-08-17T02:27:22.703760+0000","last_active":"2024-08-17T02:27:22.706909+0000","last_peered":"2024-08-17T02:27:22.706909+0000","last_clean":"2024-08-17T02:27:22.706909+0000","last_became_active":"2024-08-17T02:27:22.703453+0000","last_became_peered":"2024-08-17T02:27:22.703453+0000","last_unstale":"2024-08-17T02:27:22.706909+0000","last_undegraded":"2024-08-17T02:27:22.706909+0000","last_fullsized":"2024-08-17T02:27:22.706909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720580+0000","last_change":"2024-08-17T02:27:21.679961+0000","last_active":"2024-08-17T02:27:22.720580+0000","last_peered":"2024-08-17T02:27:22.720580+0000","last_clean":"2024-08-17T02:27:22.720580+0000","last_became_active":"2024-08-17T02:27:21.679617+0000","last_became_peered":"2024-08-17T02:27:21.679617+0000","last_unstale":"2024-08-17T02:27:22.720580+0000","last_undegraded":"2024-08-17T02:27:22.720580+0000","last_fullsized":"2024-08-17T02:27:22.720580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714770+0000","last_change":"2024-08-17T02:27:22.706055+0000","last_active":"2024-08-17T02:27:22.714770+0000","last_peered":"2024-08-17T02:27:22.714770+0000","last_clean":"2024-08-17T02:27:22.714770+0000","last_became_active":"2024-08-17T02:27:22.705762+0000","last_became_peered":"2024-08-17T02:27:22.705762+0000","last_unstale":"2024-08-17T02:27:22.714770+0000","last_undegraded":"2024-08-17T02:27:22.714770+0000","last_fullsized":"2024-08-17T02:27:22.714770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:10:34.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702078+0000","last_change":"2024-08-17T02:27:21.682999+0000","last_active":"2024-08-17T02:27:22.702078+0000","last_peered":"2024-08-17T02:27:22.702078+0000","last_clean":"2024-08-17T02:27:22.702078+0000","last_became_active":"2024-08-17T02:27:21.682681+0000","last_became_peered":"2024-08-17T02:27:21.682681+0000","last_unstale":"2024-08-17T02:27:22.702078+0000","last_undegraded":"2024-08-17T02:27:22.702078+0000","last_fullsized":"2024-08-17T02:27:22.702078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711176+0000","last_change":"2024-08-17T02:27:22.706043+0000","last_active":"2024-08-17T02:27:22.711176+0000","last_peered":"2024-08-17T02:27:22.711176+0000","last_clean":"2024-08-17T02:27:22.711176+0000","last_became_active":"2024-08-17T02:27:22.705777+0000","last_became_peered":"2024-08-17T02:27:22.705777+0000","last_unstale":"2024-08-17T02:27:22.711176+0000","last_undegraded":"2024-08-17T02:27:22.711176+0000","last_fullsized":"2024-08-17T02:27:22.711176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688867+0000","last_change":"2024-08-17T02:27:21.677481+0000","last_active":"2024-08-17T02:27:22.688867+0000","last_peered":"2024-08-17T02:27:22.688867+0000","last_clean":"2024-08-17T02:27:22.688867+0000","last_became_active":"2024-08-17T02:27:21.676761+0000","last_became_peered":"2024-08-17T02:27:21.676761+0000","last_unstale":"2024-08-17T02:27:22.688867+0000","last_undegraded":"2024-08-17T02:27:22.688867+0000","last_fullsized":"2024-08-17T02:27:22.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:08.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711894+0000","last_change":"2024-08-17T02:27:22.711222+0000","last_active":"2024-08-17T02:27:22.711894+0000","last_peered":"2024-08-17T02:27:22.711894+0000","last_clean":"2024-08-17T02:27:22.711894+0000","last_became_active":"2024-08-17T02:27:22.710967+0000","last_became_peered":"2024-08-17T02:27:22.710967+0000","last_unstale":"2024-08-17T02:27:22.711894+0000","last_undegraded":"2024-08-17T02:27:22.711894+0000","last_fullsized":"2024-08-17T02:27:22.711894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:43.683949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695550+0000","last_change":"2024-08-17T02:27:21.687679+0000","last_active":"2024-08-17T02:27:22.695550+0000","last_peered":"2024-08-17T02:27:22.695550+0000","last_clean":"2024-08-17T02:27:22.695550+0000","last_became_active":"2024-08-17T02:27:21.687401+0000","last_became_peered":"2024-08-17T02:27:21.687401+0000","last_unstale":"2024-08-17T02:27:22.695550+0000","last_undegraded":"2024-08-17T02:27:22.695550+0000","last_fullsized":"2024-08-17T02:27:22.695550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:38.795028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720949+0000","last_change":"2024-08-17T02:27:22.719603+0000","last_active":"2024-08-17T02:27:22.720949+0000","last_peered":"2024-08-17T02:27:22.720949+0000","last_clean":"2024-08-17T02:27:22.720949+0000","last_became_active":"2024-08-17T02:27:22.719280+0000","last_became_peered":"2024-08-17T02:27:22.719280+0000","last_unstale":"2024-08-17T02:27:22.720949+0000","last_undegraded":"2024-08-17T02:27:22.720949+0000","last_fullsized":"2024-08-17T02:27:22.720949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719573+0000","last_change":"2024-08-17T02:27:21.679122+0000","last_active":"2024-08-17T02:27:22.719573+0000","last_peered":"2024-08-17T02:27:22.719573+0000","last_clean":"2024-08-17T02:27:22.719573+0000","last_became_active":"2024-08-17T02:27:21.678813+0000","last_became_peered":"2024-08-17T02:27:21.678813+0000","last_unstale":"2024-08-17T02:27:22.719573+0000","last_undegraded":"2024-08-17T02:27:22.719573+0000","last_fullsized":"2024-08-17T02:27:22.719573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706847+0000","last_change":"2024-08-17T02:27:22.703352+0000","last_active":"2024-08-17T02:27:22.706847+0000","last_peered":"2024-08-17T02:27:22.706847+0000","last_clean":"2024-08-17T02:27:22.706847+0000","last_became_active":"2024-08-17T02:27:22.703066+0000","last_became_peered":"2024-08-17T02:27:22.703066+0000","last_unstale":"2024-08-17T02:27:22.706847+0000","last_undegraded":"2024-08-17T02:27:22.706847+0000","last_fullsized":"2024-08-17T02:27:22.706847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718462+0000","last_change":"2024-08-17T02:27:21.684496+0000","last_active":"2024-08-17T02:27:22.718462+0000","last_peered":"2024-08-17T02:27:22.718462+0000","last_clean":"2024-08-17T02:27:22.718462+0000","last_became_active":"2024-08-17T02:27:21.684210+0000","last_became_peered":"2024-08-17T02:27:21.684210+0000","last_unstale":"2024-08-17T02:27:22.718462+0000","last_undegraded":"2024-08-17T02:27:22.718462+0000","last_fullsized":"2024-08-17T02:27:22.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:46.288307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712912+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.712912+0000","last_peered":"2024-08-17T02:27:22.712912+0000","last_clean":"2024-08-17T02:27:22.712912+0000","last_became_active":"2024-08-17T02:27:22.709505+0000","last_became_peered":"2024-08-17T02:27:22.709505+0000","last_unstale":"2024-08-17T02:27:22.712912+0000","last_undegraded":"2024-08-17T02:27:22.712912+0000","last_fullsized":"2024-08-17T02:27:22.712912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:09.433325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714732+0000","last_change":"2024-08-17T02:27:21.676534+0000","last_active":"2024-08-17T02:27:22.714732+0000","last_peered":"2024-08-17T02:27:22.714732+0000","last_clean":"2024-08-17T02:27:22.714732+0000","last_became_active":"2024-08-17T02:27:21.676222+0000","last_became_peered":"2024-08-17T02:27:21.676222+0000","last_unstale":"2024-08-17T02:27:22.714732+0000","last_undegraded":"2024-08-17T02:27:22.714732+0000","last_fullsized":"2024-08-17T02:27:22.714732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714565+0000","last_change":"2024-08-17T02:27:22.710824+0000","last_active":"2024-08-17T02:27:22.714565+0000","last_peered":"2024-08-17T02:27:22.714565+0000","last_clean":"2024-08-17T02:27:22.714565+0000","last_became_active":"2024-08-17T02:27:22.710510+0000","last_became_peered":"2024-08-17T02:27:22.710510+0000","last_unstale":"2024-08-17T02:27:22.714565+0000","last_undegraded":"2024-08-17T02:27:22.714565+0000","last_fullsized":"2024-08-17T02:27:22.714565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:04.586592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717136+0000","last_change":"2024-08-17T02:27:21.682443+0000","last_active":"2024-08-17T02:27:22.717136+0000","last_peered":"2024-08-17T02:27:22.717136+0000","last_clean":"2024-08-17T02:27:22.717136+0000","last_became_active":"2024-08-17T02:27:21.682090+0000","last_became_peered":"2024-08-17T02:27:21.682090+0000","last_unstale":"2024-08-17T02:27:22.717136+0000","last_undegraded":"2024-08-17T02:27:22.717136+0000","last_fullsized":"2024-08-17T02:27:22.717136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721878+0000","last_change":"2024-08-17T02:27:22.714014+0000","last_active":"2024-08-17T02:27:22.721878+0000","last_peered":"2024-08-17T02:27:22.721878+0000","last_clean":"2024-08-17T02:27:22.721878+0000","last_became_active":"2024-08-17T02:27:22.710360+0000","last_became_peered":"2024-08-17T02:27:22.710360+0000","last_unstale":"2024-08-17T02:27:22.721878+0000","last_undegraded":"2024-08-17T02:27:22.721878+0000","last_fullsized":"2024-08-17T02:27:22.721878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:13.548023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695461+0000","last_change":"2024-08-17T02:27:21.684019+0000","last_active":"2024-08-17T02:27:22.695461+0000","last_peered":"2024-08-17T02:27:22.695461+0000","last_clean":"2024-08-17T02:27:22.695461+0000","last_became_active":"2024-08-17T02:27:21.683698+0000","last_became_peered":"2024-08-17T02:27:21.683698+0000","last_unstale":"2024-08-17T02:27:22.695461+0000","last_undegraded":"2024-08-17T02:27:22.695461+0000","last_fullsized":"2024-08-17T02:27:22.695461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707656+0000","last_change":"2024-08-17T02:27:22.704813+0000","last_active":"2024-08-17T02:27:22.707656+0000","last_peered":"2024-08-17T02:27:22.707656+0000","last_clean":"2024-08-17T02:27:22.707656+0000","last_became_active":"2024-08-17T02:27:22.703693+0000","last_became_peered":"2024-08-17T02:27:22.703693+0000","last_unstale":"2024-08-17T02:27:22.707656+0000","last_undegraded":"2024-08-17T02:27:22.707656+0000","last_fullsized":"2024-08-17T02:27:22.707656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:43.268210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.698112+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:22.698112+0000","last_peered":"2024-08-17T02:27:22.698112+0000","last_clean":"2024-08-17T02:27:22.698112+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:22.698112+0000","last_undegraded":"2024-08-17T02:27:22.698112+0000","last_fullsized":"2024-08-17T02:27:22.698112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688750+0000","last_change":"2024-08-17T02:27:21.677758+0000","last_active":"2024-08-17T02:27:22.688750+0000","last_peered":"2024-08-17T02:27:22.688750+0000","last_clean":"2024-08-17T02:27:22.688750+0000","last_became_active":"2024-08-17T02:27:21.677435+0000","last_became_peered":"2024-08-17T02:27:21.677435+0000","last_unstale":"2024-08-17T02:27:22.688750+0000","last_undegraded":"2024-08-17T02:27:22.688750+0000","last_fullsized":"2024-08-17T02:27:22.688750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:17.811669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718263+0000","last_change":"2024-08-17T02:27:22.707547+0000","last_active":"2024-08-17T02:27:22.718263+0000","last_peered":"2024-08-17T02:27:22.718263+0000","last_clean":"2024-08-17T02:27:22.718263+0000","last_became_active":"2024-08-17T02:27:22.707067+0000","last_became_peered":"2024-08-17T02:27:22.707067+0000","last_unstale":"2024-08-17T02:27:22.718263+0000","last_undegraded":"2024-08-17T02:27:22.718263+0000","last_fullsized":"2024-08-17T02:27:22.718263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:54.622575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688823+0000","last_change":"2024-08-17T02:27:21.679784+0000","last_active":"2024-08-17T02:27:22.688823+0000","last_peered":"2024-08-17T02:27:22.688823+0000","last_clean":"2024-08-17T02:27:22.688823+0000","last_became_active":"2024-08-17T02:27:21.679452+0000","last_became_peered":"2024-08-17T02:27:21.679452+0000","last_unstale":"2024-08-17T02:27:22.688823+0000","last_undegraded":"2024-08-17T02:27:22.688823+0000","last_fullsized":"2024-08-17T02:27:22.688823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:59.136904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707149+0000","last_change":"2024-08-17T02:27:22.703264+0000","last_active":"2024-08-17T02:27:22.707149+0000","last_peered":"2024-08-17T02:27:22.707149+0000","last_clean":"2024-08-17T02:27:22.707149+0000","last_became_active":"2024-08-17T02:27:22.702948+0000","last_became_peered":"2024-08-17T02:27:22.702948+0000","last_unstale":"2024-08-17T02:27:22.707149+0000","last_undegraded":"2024-08-17T02:27:22.707149+0000","last_fullsized":"2024-08-17T02:27:22.707149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688627+0000","last_change":"2024-08-17T02:27:21.679287+0000","last_active":"2024-08-17T02:27:22.688627+0000","last_peered":"2024-08-17T02:27:22.688627+0000","last_clean":"2024-08-17T02:27:22.688627+0000","last_became_active":"2024-08-17T02:27:21.678975+0000","last_became_peered":"2024-08-17T02:27:21.678975+0000","last_unstale":"2024-08-17T02:27:22.688627+0000","last_undegraded":"2024-08-17T02:27:22.688627+0000","last_fullsized":"2024-08-17T02:27:22.688627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717995+0000","last_change":"2024-08-17T02:27:22.713099+0000","last_active":"2024-08-17T02:27:22.717995+0000","last_peered":"2024-08-17T02:27:22.717995+0000","last_clean":"2024-08-17T02:27:22.717995+0000","last_became_active":"2024-08-17T02:27:22.712804+0000","last_became_peered":"2024-08-17T02:27:22.712804+0000","last_unstale":"2024-08-17T02:27:22.717995+0000","last_undegraded":"2024-08-17T02:27:22.717995+0000","last_fullsized":"2024-08-17T02:27:22.717995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689010+0000","last_change":"2024-08-17T02:27:21.682058+0000","last_active":"2024-08-17T02:27:22.689010+0000","last_peered":"2024-08-17T02:27:22.689010+0000","last_clean":"2024-08-17T02:27:22.689010+0000","last_became_active":"2024-08-17T02:27:21.681408+0000","last_became_peered":"2024-08-17T02:27:21.681408+0000","last_unstale":"2024-08-17T02:27:22.689010+0000","last_undegraded":"2024-08-17T02:27:22.689010+0000","last_fullsized":"2024-08-17T02:27:22.689010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:58.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722390+0000","last_change":"2024-08-17T02:27:22.718925+0000","last_active":"2024-08-17T02:27:22.722390+0000","last_peered":"2024-08-17T02:27:22.722390+0000","last_clean":"2024-08-17T02:27:22.722390+0000","last_became_active":"2024-08-17T02:27:22.718611+0000","last_became_peered":"2024-08-17T02:27:22.718611+0000","last_unstale":"2024-08-17T02:27:22.722390+0000","last_undegraded":"2024-08-17T02:27:22.722390+0000","last_fullsized":"2024-08-17T02:27:22.722390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:38.536122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710005+0000","last_change":"2024-08-17T02:27:21.680603+0000","last_active":"2024-08-17T02:27:22.710005+0000","last_peered":"2024-08-17T02:27:22.710005+0000","last_clean":"2024-08-17T02:27:22.710005+0000","last_became_active":"2024-08-17T02:27:21.680266+0000","last_became_peered":"2024-08-17T02:27:21.680266+0000","last_unstale":"2024-08-17T02:27:22.710005+0000","last_undegraded":"2024-08-17T02:27:22.710005+0000","last_fullsized":"2024-08-17T02:27:22.710005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706471+0000","last_change":"2024-08-17T02:27:22.701991+0000","last_active":"2024-08-17T02:27:22.706471+0000","last_peered":"2024-08-17T02:27:22.706471+0000","last_clean":"2024-08-17T02:27:22.706471+0000","last_became_active":"2024-08-17T02:27:22.701697+0000","last_became_peered":"2024-08-17T02:27:22.701697+0000","last_unstale":"2024-08-17T02:27:22.706471+0000","last_undegraded":"2024-08-17T02:27:22.706471+0000","last_fullsized":"2024-08-17T02:27:22.706471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689440+0000","last_change":"2024-08-17T02:27:21.680806+0000","last_active":"2024-08-17T02:27:22.689440+0000","last_peered":"2024-08-17T02:27:22.689440+0000","last_clean":"2024-08-17T02:27:22.689440+0000","last_became_active":"2024-08-17T02:27:21.680436+0000","last_became_peered":"2024-08-17T02:27:21.680436+0000","last_unstale":"2024-08-17T02:27:22.689440+0000","last_undegraded":"2024-08-17T02:27:22.689440+0000","last_fullsized":"2024-08-17T02:27:22.689440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:54.813140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712702+0000","last_change":"2024-08-17T02:27:22.708669+0000","last_active":"2024-08-17T02:27:22.712702+0000","last_peered":"2024-08-17T02:27:22.712702+0000","last_clean":"2024-08-17T02:27:22.712702+0000","last_became_active":"2024-08-17T02:27:22.708410+0000","last_became_peered":"2024-08-17T02:27:22.708410+0000","last_unstale":"2024-08-17T02:27:22.712702+0000","last_undegraded":"2024-08-17T02:27:22.712702+0000","last_fullsized":"2024-08-17T02:27:22.712702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:41.242530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702782+0000","last_change":"2024-08-17T02:27:21.687483+0000","last_active":"2024-08-17T02:27:22.702782+0000","last_peered":"2024-08-17T02:27:22.702782+0000","last_clean":"2024-08-17T02:27:22.702782+0000","last_became_active":"2024-08-17T02:27:21.687178+0000","last_became_peered":"2024-08-17T02:27:21.687178+0000","last_unstale":"2024-08-17T02:27:22.702782+0000","last_undegraded":"2024-08-17T02:27:22.702782+0000","last_fullsized":"2024-08-17T02:27:22.702782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719763+0000","last_change":"2024-08-17T02:27:22.712440+0000","last_active":"2024-08-17T02:27:22.719763+0000","last_peered":"2024-08-17T02:27:22.719763+0000","last_clean":"2024-08-17T02:27:22.719763+0000","last_became_active":"2024-08-17T02:27:22.709883+0000","last_became_peered":"2024-08-17T02:27:22.709883+0000","last_unstale":"2024-08-17T02:27:22.719763+0000","last_undegraded":"2024-08-17T02:27:22.719763+0000","last_fullsized":"2024-08-17T02:27:22.719763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715159+0000","last_change":"2024-08-17T02:27:21.684633+0000","last_active":"2024-08-17T02:27:22.715159+0000","last_peered":"2024-08-17T02:27:22.715159+0000","last_clean":"2024-08-17T02:27:22.715159+0000","last_became_active":"2024-08-17T02:27:21.684363+0000","last_became_peered":"2024-08-17T02:27:21.684363+0000","last_unstale":"2024-08-17T02:27:22.715159+0000","last_undegraded":"2024-08-17T02:27:22.715159+0000","last_fullsized":"2024-08-17T02:27:22.715159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:28.025035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719493+0000","last_change":"2024-08-17T02:27:22.712731+0000","last_active":"2024-08-17T02:27:22.719493+0000","last_peered":"2024-08-17T02:27:22.719493+0000","last_clean":"2024-08-17T02:27:22.719493+0000","last_became_active":"2024-08-17T02:27:22.712439+0000","last_became_peered":"2024-08-17T02:27:22.712439+0000","last_unstale":"2024-08-17T02:27:22.719493+0000","last_undegraded":"2024-08-17T02:27:22.719493+0000","last_fullsized":"2024-08-17T02:27:22.719493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:11.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694453+0000","last_change":"2024-08-17T02:27:21.683181+0000","last_active":"2024-08-17T02:27:22.694453+0000","last_peered":"2024-08-17T02:27:22.694453+0000","last_clean":"2024-08-17T02:27:22.694453+0000","last_became_active":"2024-08-17T02:27:21.682819+0000","last_became_peered":"2024-08-17T02:27:21.682819+0000","last_unstale":"2024-08-17T02:27:22.694453+0000","last_undegraded":"2024-08-17T02:27:22.694453+0000","last_fullsized":"2024-08-17T02:27:22.694453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:38.047941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710652+0000","last_change":"2024-08-17T02:27:22.708585+0000","last_active":"2024-08-17T02:27:22.710652+0000","last_peered":"2024-08-17T02:27:22.710652+0000","last_clean":"2024-08-17T02:27:22.710652+0000","last_became_active":"2024-08-17T02:27:22.708311+0000","last_became_peered":"2024-08-17T02:27:22.708311+0000","last_unstale":"2024-08-17T02:27:22.710652+0000","last_undegraded":"2024-08-17T02:27:22.710652+0000","last_fullsized":"2024-08-17T02:27:22.710652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:09.513436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.700112+0000","last_change":"2024-08-17T02:27:21.680475+0000","last_active":"2024-08-17T02:27:22.700112+0000","last_peered":"2024-08-17T02:27:22.700112+0000","last_clean":"2024-08-17T02:27:22.700112+0000","last_became_active":"2024-08-17T02:27:21.680155+0000","last_became_peered":"2024-08-17T02:27:21.680155+0000","last_unstale":"2024-08-17T02:27:22.700112+0000","last_undegraded":"2024-08-17T02:27:22.700112+0000","last_fullsized":"2024-08-17T02:27:22.700112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719660+0000","last_change":"2024-08-17T02:27:22.714582+0000","last_active":"2024-08-17T02:27:22.719660+0000","last_peered":"2024-08-17T02:27:22.719660+0000","last_clean":"2024-08-17T02:27:22.719660+0000","last_became_active":"2024-08-17T02:27:22.713772+0000","last_became_peered":"2024-08-17T02:27:22.713772+0000","last_unstale":"2024-08-17T02:27:22.719660+0000","last_undegraded":"2024-08-17T02:27:22.719660+0000","last_fullsized":"2024-08-17T02:27:22.719660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:45.892893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695233+0000","last_change":"2024-08-17T02:27:21.676299+0000","last_active":"2024-08-17T02:27:22.695233+0000","last_peered":"2024-08-17T02:27:22.695233+0000","last_clean":"2024-08-17T02:27:22.695233+0000","last_became_active":"2024-08-17T02:27:21.676010+0000","last_became_peered":"2024-08-17T02:27:21.676010+0000","last_unstale":"2024-08-17T02:27:22.695233+0000","last_undegraded":"2024-08-17T02:27:22.695233+0000","last_fullsized":"2024-08-17T02:27:22.695233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706737+0000","last_change":"2024-08-17T02:27:22.701911+0000","last_active":"2024-08-17T02:27:22.706737+0000","last_peered":"2024-08-17T02:27:22.706737+0000","last_clean":"2024-08-17T02:27:22.706737+0000","last_became_active":"2024-08-17T02:27:22.701476+0000","last_became_peered":"2024-08-17T02:27:22.701476+0000","last_unstale":"2024-08-17T02:27:22.706737+0000","last_undegraded":"2024-08-17T02:27:22.706737+0000","last_fullsized":"2024-08-17T02:27:22.706737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710030+0000","last_change":"2024-08-17T02:27:21.678821+0000","last_active":"2024-08-17T02:27:22.710030+0000","last_peered":"2024-08-17T02:27:22.710030+0000","last_clean":"2024-08-17T02:27:22.710030+0000","last_became_active":"2024-08-17T02:27:21.678526+0000","last_became_peered":"2024-08-17T02:27:21.678526+0000","last_unstale":"2024-08-17T02:27:22.710030+0000","last_undegraded":"2024-08-17T02:27:22.710030+0000","last_fullsized":"2024-08-17T02:27:22.710030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:08.424907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707059+0000","last_change":"2024-08-17T02:27:22.703460+0000","last_active":"2024-08-17T02:27:22.707059+0000","last_peered":"2024-08-17T02:27:22.707059+0000","last_clean":"2024-08-17T02:27:22.707059+0000","last_became_active":"2024-08-17T02:27:22.703160+0000","last_became_peered":"2024-08-17T02:27:22.703160+0000","last_unstale":"2024-08-17T02:27:22.707059+0000","last_undegraded":"2024-08-17T02:27:22.707059+0000","last_fullsized":"2024-08-17T02:27:22.707059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:06.070316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710345+0000","last_change":"2024-08-17T02:27:22.707465+0000","last_active":"2024-08-17T02:27:22.710345+0000","last_peered":"2024-08-17T02:27:22.710345+0000","last_clean":"2024-08-17T02:27:22.710345+0000","last_became_active":"2024-08-17T02:27:22.707187+0000","last_became_peered":"2024-08-17T02:27:22.707187+0000","last_unstale":"2024-08-17T02:27:22.710345+0000","last_undegraded":"2024-08-17T02:27:22.710345+0000","last_fullsized":"2024-08-17T02:27:22.710345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:54.375406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710322+0000","last_change":"2024-08-17T02:27:21.684023+0000","last_active":"2024-08-17T02:27:22.710322+0000","last_peered":"2024-08-17T02:27:22.710322+0000","last_clean":"2024-08-17T02:27:22.710322+0000","last_became_active":"2024-08-17T02:27:21.683523+0000","last_became_peered":"2024-08-17T02:27:21.683523+0000","last_unstale":"2024-08-17T02:27:22.710322+0000","last_undegraded":"2024-08-17T02:27:22.710322+0000","last_fullsized":"2024-08-17T02:27:22.710322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:01.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717622+0000","last_change":"2024-08-17T02:27:22.715898+0000","last_active":"2024-08-17T02:27:22.717622+0000","last_peered":"2024-08-17T02:27:22.717622+0000","last_clean":"2024-08-17T02:27:22.717622+0000","last_became_active":"2024-08-17T02:27:22.715593+0000","last_became_peered":"2024-08-17T02:27:22.715593+0000","last_unstale":"2024-08-17T02:27:22.717622+0000","last_undegraded":"2024-08-17T02:27:22.717622+0000","last_fullsized":"2024-08-17T02:27:22.717622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:07.864704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714250+0000","last_change":"2024-08-17T02:27:21.679701+0000","last_active":"2024-08-17T02:27:22.714250+0000","last_peered":"2024-08-17T02:27:22.714250+0000","last_clean":"2024-08-17T02:27:22.714250+0000","last_became_active":"2024-08-17T02:27:21.679276+0000","last_became_peered":"2024-08-17T02:27:21.679276+0000","last_unstale":"2024-08-17T02:27:22.714250+0000","last_undegraded":"2024-08-17T02:27:22.714250+0000","last_fullsized":"2024-08-17T02:27:22.714250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:06.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719485+0000","last_change":"2024-08-17T02:27:22.715682+0000","last_active":"2024-08-17T02:27:22.719485+0000","last_peered":"2024-08-17T02:27:22.719485+0000","last_clean":"2024-08-17T02:27:22.719485+0000","last_became_active":"2024-08-17T02:27:22.714110+0000","last_became_peered":"2024-08-17T02:27:22.714110+0000","last_unstale":"2024-08-17T02:27:22.719485+0000","last_undegraded":"2024-08-17T02:27:22.719485+0000","last_fullsized":"2024-08-17T02:27:22.719485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718562+0000","last_change":"2024-08-17T02:27:21.676227+0000","last_active":"2024-08-17T02:27:22.718562+0000","last_peered":"2024-08-17T02:27:22.718562+0000","last_clean":"2024-08-17T02:27:22.718562+0000","last_became_active":"2024-08-17T02:27:21.675914+0000","last_became_peered":"2024-08-17T02:27:21.675914+0000","last_unstale":"2024-08-17T02:27:22.718562+0000","last_undegraded":"2024-08-17T02:27:22.718562+0000","last_fullsized":"2024-08-17T02:27:22.718562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718657+0000","last_change":"2024-08-17T02:27:22.713584+0000","last_active":"2024-08-17T02:27:22.718657+0000","last_peered":"2024-08-17T02:27:22.718657+0000","last_clean":"2024-08-17T02:27:22.718657+0000","last_became_active":"2024-08-17T02:27:22.710898+0000","last_became_peered":"2024-08-17T02:27:22.710898+0000","last_unstale":"2024-08-17T02:27:22.718657+0000","last_undegraded":"2024-08-17T02:27:22.718657+0000","last_fullsized":"2024-08-17T02:27:22.718657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718550+0000","last_change":"2024-08-17T02:27:21.683370+0000","last_active":"2024-08-17T02:27:22.718550+0000","last_peered":"2024-08-17T02:27:22.718550+0000","last_clean":"2024-08-17T02:27:22.718550+0000","last_became_active":"2024-08-17T02:27:21.683066+0000","last_became_peered":"2024-08-17T02:27:21.683066+0000","last_unstale":"2024-08-17T02:27:22.718550+0000","last_undegraded":"2024-08-17T02:27:22.718550+0000","last_fullsized":"2024-08-17T02:27:22.718550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":73913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":663238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":76001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":811008,"data_stored":664227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:30.400 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:30.400 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:27:30.400 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:27:30.401 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:27:30.401 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:27:30.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 Processor -- start 2024-08-17T02:27:30.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 -- start start 2024-08-17T02:27:30.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 0x7fa384157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa384157890 0x7fa3840aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840adf50 con 0x7fa384156f80 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3840ad340 con 0x7fa384157890 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa388d95700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840ad620 con 0x7fa3840ace80 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa381d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 0x7fa384157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa382d9d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa384157890 0x7fa3840aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa38259c700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa384156f80 0x7fa3840ae3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46836/0 (socket says 172.21.15.155:46836) 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa38259c700 1 -- 172.21.15.155:0/3251410759 learned_addr learned my addr 172.21.15.155:0/3251410759 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:30.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa38159a700 1 -- 172.21.15.155:0/3251410759 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771057766 0 0) 0x7fa3840adf50 con 0x7fa384156f80 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.504+0000 7fa38159a700 1 -- 172.21.15.155:0/3251410759 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa370003570 con 0x7fa384156f80 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa382d9d700 1 -- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 msgr2=0x7fa384157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa382d9d700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 0x7fa384157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa382d9d700 1 -- 172.21.15.155:0/3251410759 >> v1:172.21.15.189:6789/0 conn(0x7fa384156f80 legacy=0x7fa3840ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa382d9d700 1 -- 172.21.15.155:0/3251410759 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840ad900 con 0x7fa384157890 2024-08-17T02:27:30.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa381d9b700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 0x7fa384157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa382d9d700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa384157890 0x7fa3840aab70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009e60 tx=0x7fa37c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23835a38fb23e734 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa38159a700 1 -- 172.21.15.155:0/3251410759 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00e070 con 0x7fa384157890 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa38159a700 1 -- 172.21.15.155:0/3251410759 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c00bab0 con 0x7fa384157890 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa38159a700 1 -- 172.21.15.155:0/3251410759 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00be70 con 0x7fa384157890 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa384157890 msgr2=0x7fa3840aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa384157890 0x7fa3840aab70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009e60 tx=0x7fa37c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- 172.21.15.155:0/3251410759 shutdown_connections 2024-08-17T02:27:30.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa384157890 0x7fa3840aab70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 --2- 172.21.15.155:0/3251410759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa3840ace80 0x7fa384157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- 172.21.15.155:0/3251410759 >> 172.21.15.155:0/3251410759 conn(0x7fa384066e00 msgr2=0x7fa384067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- 172.21.15.155:0/3251410759 shutdown_connections 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- 172.21.15.155:0/3251410759 wait complete. 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 Processor -- start 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.508+0000 7fa388d95700 1 -- start start 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3840ace80 0x7fa38416a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 0x7fa38416aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 0x7fa3840978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384168d90 con 0x7fa384157890 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384168180 con 0x7fa3840ace80 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384168460 con 0x7fa384156f80 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa382d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 0x7fa3840978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa38259c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3840ace80 0x7fa38416a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 0x7fa38416aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa382d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 0x7fa3840978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50058/0 (socket says 172.21.15.155:50058) 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa382d9d700 1 -- 172.21.15.155:0/1501305503 learned_addr learned my addr 172.21.15.155:0/1501305503 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 -- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3840ace80 msgr2=0x7fa38416a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3840ace80 0x7fa38416a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 -- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 msgr2=0x7fa3840978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 0x7fa3840978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 -- 172.21.15.155:0/1501305503 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009420 con 0x7fa384156f80 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa381d9b700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 0x7fa38416aa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa37400ec50 tx=0x7fa3740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374009700 con 0x7fa384156f80 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400c850 con 0x7fa384156f80 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c009a20 con 0x7fa384156f80 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400cbf0 con 0x7fa384156f80 2024-08-17T02:27:30.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa384168a20 con 0x7fa384156f80 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.512+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa384168f40 con 0x7fa384156f80 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.516+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa37400cd50 con 0x7fa384156f80 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.516+0000 7fa37a7fc700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 0x7fa364062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.516+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa37407cf60 con 0x7fa384156f80 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.516+0000 7fa38259c700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 0x7fa364062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.516+0000 7fa38259c700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 0x7fa364062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa36c007fd0 tx=0x7fa36c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.524+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa37404d430 con 0x7fa384156f80 2024-08-17T02:27:30.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.732+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa384168f00 con 0x7fa384156f80 2024-08-17T02:27:30.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.736+0000 7fa37a7fc700 1 -- 172.21.15.155:0/1501305503 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154540 (secure 0 0 0) 0x7fa374017090 con 0x7fa384156f80 2024-08-17T02:27:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:30.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 msgr2=0x7fa364062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 0x7fa364062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa36c007fd0 tx=0x7fa36c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 msgr2=0x7fa38416aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 0x7fa38416aa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa37400ec50 tx=0x7fa3740091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 shutdown_connections 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa364060860 0x7fa364062d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa384157890 0x7fa3840978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa384156f80 0x7fa38416aa50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 --2- 172.21.15.155:0/1501305503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3840ace80 0x7fa38416a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 >> 172.21.15.155:0/1501305503 conn(0x7fa384066e00 msgr2=0x7fa38406d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 shutdown_connections 2024-08-17T02:27:30.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.740+0000 7fa388d95700 1 -- 172.21.15.155:0/1501305503 wait complete. 2024-08-17T02:27:30.757 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":24098},{"type":"v1","addr":"172.21.15.155:6833","nonce":24098}]},"active_addr":"172.21.15.155:6833/24098","active_change":"2024-08-17T02:27:09.923309+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":4105379073}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":42100121}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2722668844}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3089573052}]}]} 2024-08-17T02:27:30.760 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:27:30.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:27:30.760 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:30.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 Processor -- start 2024-08-17T02:27:30.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 -- start start 2024-08-17T02:27:30.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c815d540 0x7ff7c80af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff7c806e830 0x7ff7c80a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80b0270 con 0x7ff7c80a9260 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80af660 con 0x7ff7c815d540 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7ce3a8700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80af940 con 0x7ff7c806e830 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c815d540 0x7ff7c80af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c815d540 0x7ff7c80af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50074/0 (socket says 172.21.15.155:50074) 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3199206390 learned_addr learned my addr 172.21.15.155:0/3199206390 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c77fe700 1 --2- 172.21.15.155:0/3199206390 >> v2:172.21.15.189:3300/0 conn(0x7ff7c806e830 0x7ff7c80a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3199206390 >> v2:172.21.15.189:3300/0 conn(0x7ff7c806e830 msgr2=0x7ff7c80a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 --2- 172.21.15.155:0/3199206390 >> v2:172.21.15.189:3300/0 conn(0x7ff7c806e830 0x7ff7c80a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3199206390 >> v1:172.21.15.189:6789/0 conn(0x7ff7c80a9260 legacy=0x7ff7c80b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.860+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3199206390 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80afc20 con 0x7ff7c815d540 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7c7fff700 1 --2- 172.21.15.155:0/3199206390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c815d540 0x7ff7c80af030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806c970 tx=0x7ff7bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1927ba9b99f9dee7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7c6ffd700 1 -- 172.21.15.155:0/3199206390 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc009e70 con 0x7ff7c815d540 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7c6ffd700 1 -- 172.21.15.155:0/3199206390 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00b860 con 0x7ff7c815d540 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7c6ffd700 1 -- 172.21.15.155:0/3199206390 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00bc00 con 0x7ff7c815d540 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3199206390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c815d540 msgr2=0x7ff7c80af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3199206390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c815d540 0x7ff7c80af030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806c970 tx=0x7ff7bc009250 comp rx=0 tx=0).stop 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3199206390 shutdown_connections 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3199206390 >> v2:172.21.15.189:3300/0 conn(0x7ff7c806e830 0x7ff7c80a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3199206390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c815d540 0x7ff7c80af030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3199206390 >> 172.21.15.155:0/3199206390 conn(0x7ff7c8066e00 msgr2=0x7ff7c8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3199206390 shutdown_connections 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3199206390 wait complete. 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 Processor -- start 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.864+0000 7ff7ce3a8700 1 -- start start 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7c80a9260 0x7ff7c8158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7c815d540 0x7ff7c8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8097a00 con 0x7ff7c806e830 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80969f0 con 0x7ff7c80a9260 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8097570 con 0x7ff7c815d540 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50078/0 (socket says 172.21.15.155:50078) 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3806845527 learned_addr learned my addr 172.21.15.155:0/3806845527 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c77fe700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7c80a9260 0x7ff7c8158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7cc945700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7c815d540 0x7ff7c8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7c815d540 msgr2=0x7ff7c8159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7c815d540 0x7ff7c8159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7c80a9260 msgr2=0x7ff7c8158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7c80a9260 0x7ff7c8158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 -- 172.21.15.155:0/3806845527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0094f0 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7c7fff700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc006fd0 tx=0x7ff7bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00bbe0 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc011420 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0117e0 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c8096c40 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.868+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c8097200 con 0x7ff7c806e830 2024-08-17T02:27:30.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c80645c0 con 0x7ff7c806e830 2024-08-17T02:27:30.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff7bc011c10 con 0x7ff7c806e830 2024-08-17T02:27:30.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7affff700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 0x7ff7b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7bc07e340 con 0x7ff7c806e830 2024-08-17T02:27:30.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7c77fe700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 0x7ff7b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.872+0000 7ff7c77fe700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 0x7ff7b4062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8170f50 tx=0x7ff7b80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:30.880+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff7bc04e790 con 0x7ff7c806e830 2024-08-17T02:27:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.044+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c806f360 con 0x7ff7c806e830 2024-08-17T02:27:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.044+0000 7ff7affff700 1 -- 172.21.15.155:0/3806845527 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff7bc051db0 con 0x7ff7c806e830 2024-08-17T02:27:31.050 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:31.050 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 msgr2=0x7ff7b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 0x7ff7b4062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8170f50 tx=0x7ff7b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 msgr2=0x7ff7c80adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc006fd0 tx=0x7ff7bc017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 shutdown_connections 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff7b4060860 0x7ff7b4062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff7c815d540 0x7ff7c8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7c80a9260 0x7ff7c8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 --2- 172.21.15.155:0/3806845527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c806e830 0x7ff7c80adde0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 >> 172.21.15.155:0/3806845527 conn(0x7ff7c8066e00 msgr2=0x7ff7c8158120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 shutdown_connections 2024-08-17T02:27:31.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.048+0000 7ff7ce3a8700 1 -- 172.21.15.155:0/3806845527 wait complete. 2024-08-17T02:27:31.068 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:27:31.068 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:31.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.172+0000 7f04ed049700 1 Processor -- start 2024-08-17T02:27:31.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.172+0000 7f04ed049700 1 -- start start 2024-08-17T02:27:31.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04e8155d20 0x7f04e80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80af2b0 con 0x7f04e80ad7c0 2024-08-17T02:27:31.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80af590 con 0x7f04e806df10 2024-08-17T02:27:31.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80adc10 con 0x7f04e8155d20 2024-08-17T02:27:31.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04dffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f04e80ad7c0 0x7f04e80aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49338/0 (socket says 172.21.15.155:49338) 2024-08-17T02:27:31.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04dffff700 1 -- 172.21.15.155:0/418852893 learned_addr learned my addr 172.21.15.155:0/418852893 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e7fff700 1 --2- 172.21.15.155:0/418852893 >> v2:172.21.15.155:3300/0 conn(0x7f04e8155d20 0x7f04e80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219703566 0 0) 0x7f04e80af2b0 con 0x7f04e80ad7c0 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d4003570 con 0x7f04e80ad7c0 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e7fff700 1 -- 172.21.15.155:0/418852893 >> v1:172.21.15.189:6789/0 conn(0x7f04e806df10 legacy=0x7f04e806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657602365 0 0) 0x7f04e80af590 con 0x7f04e806df10 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e7fff700 1 -- 172.21.15.155:0/418852893 >> v1:172.21.15.155:6789/0 conn(0x7f04e80ad7c0 legacy=0x7f04e80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e7fff700 1 -- 172.21.15.155:0/418852893 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80af870 con 0x7f04e8155d20 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e7fff700 1 --2- 172.21.15.155:0/418852893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e8155d20 0x7f04e80b0350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80098e0 tx=0x7f04d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d929c16a240ed788 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0001470 con 0x7f04e8155d20 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8011420 con 0x7f04e8155d20 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04e77fe700 1 -- 172.21.15.155:0/418852893 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80117c0 con 0x7f04e8155d20 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- 172.21.15.155:0/418852893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e8155d20 msgr2=0x7f04e80b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 --2- 172.21.15.155:0/418852893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e8155d20 0x7f04e80b0350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80098e0 tx=0x7f04d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- 172.21.15.155:0/418852893 shutdown_connections 2024-08-17T02:27:31.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 --2- 172.21.15.155:0/418852893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e8155d20 0x7f04e80b0350 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- 172.21.15.155:0/418852893 >> 172.21.15.155:0/418852893 conn(0x7f04e80678d0 msgr2=0x7f04e8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- 172.21.15.155:0/418852893 shutdown_connections 2024-08-17T02:27:31.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.176+0000 7f04ed049700 1 -- 172.21.15.155:0/418852893 wait complete. 2024-08-17T02:27:31.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 Processor -- start 2024-08-17T02:27:31.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 -- start start 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 0x7f04e816b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 0x7f04e815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e81580a0 con 0x7f04e815c860 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e816bb80 con 0x7f04e806df10 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ed049700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8157490 con 0x7f04e80ad7c0 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50082/0 (socket says 172.21.15.155:50082) 2024-08-17T02:27:31.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 -- 172.21.15.155:0/3557040661 learned_addr learned my addr 172.21.15.155:0/3557040661 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04dffff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 0x7f04e815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04e7fff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 0x7f04e816b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 -- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 msgr2=0x7f04e815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 0x7f04e815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 -- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 msgr2=0x7f04e816b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 0x7f04e816b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 -- 172.21.15.155:0/3557040661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8009420 con 0x7f04e815c860 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04e7fff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 0x7f04e816b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04dffff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 0x7f04e815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04ec848700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001560 tx=0x7f04e0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000a780 con 0x7f04e815c860 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.180+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000a8e0 con 0x7f04e815c860 2024-08-17T02:27:31.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000aca0 con 0x7f04e815c860 2024-08-17T02:27:31.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e8157770 con 0x7f04e815c860 2024-08-17T02:27:31.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e8157d30 con 0x7f04e815c860 2024-08-17T02:27:31.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e8158250 con 0x7f04e815c860 2024-08-17T02:27:31.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f04e0012630 con 0x7f04e815c860 2024-08-17T02:27:31.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04e4ff9700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 0x7f04c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04e7fff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 0x7f04c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.184+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04e007cfa0 con 0x7f04e815c860 2024-08-17T02:27:31.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.188+0000 7f04e7fff700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 0x7f04c8062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04e806cd00 tx=0x7f04d8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.192+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f04e8158250 con 0x7f04e815c860 2024-08-17T02:27:31.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.356+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04e8158250 con 0x7f04e815c860 2024-08-17T02:27:31.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.356+0000 7f04e4ff9700 1 -- 172.21.15.155:0/3557040661 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f04e8158250 con 0x7f04e815c860 2024-08-17T02:27:31.361 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:31.361 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:31.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 msgr2=0x7f04c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 0x7f04c8062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04e806cd00 tx=0x7f04d8017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 msgr2=0x7f04e8150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001560 tx=0x7f04e0001770 comp rx=0 tx=0).stop 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 shutdown_connections 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f04c8060860 0x7f04c8062d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04e815c860 0x7f04e8150c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04e80ad7c0 0x7f04e815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 --2- 172.21.15.155:0/3557040661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04e806df10 0x7f04e816b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 >> 172.21.15.155:0/3557040661 conn(0x7f04e80678d0 msgr2=0x7f04e80acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 shutdown_connections 2024-08-17T02:27:31.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.360+0000 7f04ed049700 1 -- 172.21.15.155:0/3557040661 wait complete. 2024-08-17T02:27:31.375 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:27:31.376 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:27:31.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:27:31.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:27:31.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:27:31.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:27:31.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:27:31.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:27:31.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.516+0000 7fcbc32ec700 1 Processor -- start 2024-08-17T02:27:31.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.516+0000 7fcbc32ec700 1 -- start start 2024-08-17T02:27:31.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.516+0000 7fa882b65700 1 Processor -- start 2024-08-17T02:27:31.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.516+0000 7fa882b65700 1 -- start start 2024-08-17T02:27:31.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882b65700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 0x7fa87c165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882b65700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa87c167770 0x7fa87c167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882b65700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0af2d0 con 0x7fa87c06e2e0 2024-08-17T02:27:31.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882b65700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c166420 con 0x7fa87c167770 2024-08-17T02:27:31.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882b65700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c1666d0 con 0x7fa87c06df10 2024-08-17T02:27:31.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc06e620 0x7fcbbc0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881362700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa87c06e2e0 0x7fa87c0b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46862/0 (socket says 172.21.15.155:46862) 2024-08-17T02:27:31.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881362700 1 -- 172.21.15.155:0/3196059229 learned_addr learned my addr 172.21.15.155:0/3196059229 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc0ab2d0 con 0x7fcbbc15d910 2024-08-17T02:27:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ab5b0 con 0x7fcbbc158fb0 2024-08-17T02:27:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ab890 con 0x7fcbbc06e620 2024-08-17T02:27:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 --2- 172.21.15.155:0/3196059229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 0x7fa87c165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50088/0 (socket says 172.21.15.155:50088) 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 -- 172.21.15.155:0/581273819 learned_addr learned my addr 172.21.15.155:0/581273819 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc2aeb700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc06e620 0x7fcbbc0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa882364700 1 --2- 172.21.15.155:0/3196059229 >> v2:172.21.15.189:3300/0 conn(0x7fa87c167770 0x7fa87c167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 -- 172.21.15.155:0/581273819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc06e620 msgr2=0x7fcbbc0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc06e620 0x7fcbbc0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 -- 172.21.15.155:0/581273819 >> v1:172.21.15.189:6789/0 conn(0x7fcbbc15d910 legacy=0x7fcbbc06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 -- 172.21.15.155:0/581273819 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0abb70 con 0x7fcbbc158fb0 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 -- 172.21.15.155:0/3196059229 >> v2:172.21.15.189:3300/0 conn(0x7fa87c167770 msgr2=0x7fa87c167bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 --2- 172.21.15.155:0/3196059229 >> v2:172.21.15.189:3300/0 conn(0x7fa87c167770 0x7fa87c167bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 -- 172.21.15.155:0/3196059229 >> v1:172.21.15.189:6789/0 conn(0x7fa87c06e2e0 legacy=0x7fa87c0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 -- 172.21.15.155:0/3196059229 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c1669b0 con 0x7fa87c06df10 2024-08-17T02:27:31.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc22ea700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009f20 tx=0x7fcbb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f690c0e858928bc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 Processor -- start 2024-08-17T02:27:31.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 -- start start 2024-08-17T02:27:31.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc12e8700 1 -- 172.21.15.155:0/581273819 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400e070 con 0x7fcbbc158fb0 2024-08-17T02:27:31.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc12e8700 1 -- 172.21.15.155:0/581273819 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400b9d0 con 0x7fcbbc158fb0 2024-08-17T02:27:31.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc12e8700 1 -- 172.21.15.155:0/581273819 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40092e0 con 0x7fcbbc158fb0 2024-08-17T02:27:31.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fbde753a700 1 Processor -- start 2024-08-17T02:27:31.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- 172.21.15.155:0/581273819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc158fb0 msgr2=0x7fcbbc0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009f20 tx=0x7fcbb4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- 172.21.15.155:0/581273819 shutdown_connections 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc06e620 0x7fcbbc0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/581273819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc158fb0 0x7fcbbc0aaa80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- 172.21.15.155:0/581273819 >> 172.21.15.155:0/581273819 conn(0x7fcbbc0678d0 msgr2=0x7fcbbc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fbde753a700 1 -- start start 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f159015d6d0 0x7f1590067ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159006f540 0x7f1590068410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590067a40 con 0x7f159015daa0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15900677c0 con 0x7f159015d6d0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fa881b63700 1 --2- 172.21.15.155:0/3196059229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 0x7fa87c165ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c700 tx=0x7fa87400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d28797c13ddd4ae0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f15985b1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900a8fe0 con 0x7f159006f540 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- 172.21.15.155:0/581273819 shutdown_connections 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7fcbc32ec700 1 -- 172.21.15.155:0/581273819 wait complete. 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f159634d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f159015d6d0 0x7f1590067ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f1596b4e700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f159015daa0 0x7f159015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46880/0 (socket says 172.21.15.155:46880) 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f1596b4e700 1 -- 172.21.15.155:0/3652430045 learned_addr learned my addr 172.21.15.155:0/3652430045 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f1595b4c700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159006f540 0x7f1590068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa880b61700 1 -- 172.21.15.155:0/3196059229 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874011650 con 0x7fa87c06df10 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa880b61700 1 -- 172.21.15.155:0/3196059229 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740117b0 con 0x7fa87c06df10 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa880b61700 1 -- 172.21.15.155:0/3196059229 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874011b50 con 0x7fa87c06df10 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159634d700 1 -- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159006f540 msgr2=0x7f1590068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159634d700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159006f540 0x7f1590068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159634d700 1 -- 172.21.15.155:0/3652430045 >> v1:172.21.15.189:6789/0 conn(0x7f159015daa0 legacy=0x7f159015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159634d700 1 -- 172.21.15.155:0/3652430045 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900a9280 con 0x7f159015d6d0 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159634d700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159015d6d0 0x7f1590067ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15840098e0 tx=0x7f15840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a867683398393351 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde753a700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbde006e9c0 0x7fbde0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde753a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde0157810 con 0x7fbde0153e40 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde753a700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde0157dd0 con 0x7fbde0153a70 2024-08-17T02:27:31.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde753a700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde015a700 con 0x7fbde006e9c0 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159534b700 1 -- 172.21.15.155:0/3652430045 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584011630 con 0x7f159015d6d0 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 -- 172.21.15.155:0/3196059229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 msgr2=0x7fa87c165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 --2- 172.21.15.155:0/3196059229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 0x7fa87c165ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c700 tx=0x7fa87400cac0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f67c9150700 1 Processor -- start 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.520+0000 7f67c9150700 1 -- start start 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c9150700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67c406e140 0x7f67c406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159534b700 1 -- 172.21.15.155:0/3652430045 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584011790 con 0x7f159015d6d0 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f159534b700 1 -- 172.21.15.155:0/3652430045 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584011b30 con 0x7f159015d6d0 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 Processor -- start 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 -- start start 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde52d6700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbde0153a70 0x7fbde0159c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46890/0 (socket says 172.21.15.155:46890) 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde52d6700 1 -- 172.21.15.155:0/1919162378 learned_addr learned my addr 172.21.15.155:0/1919162378 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c9150700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c41556f0 0x7f67c40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c9150700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c4156940 con 0x7f67c413e250 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c9150700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c4155b40 con 0x7f67c406e140 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c9150700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b1ba0 con 0x7f67c41556f0 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67c406e140 0x7f67c406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f67c406e140 0x7f67c406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50216/0 (socket says 172.21.15.155:50216) 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 -- 172.21.15.155:0/866830012 learned_addr learned my addr 172.21.15.155:0/866830012 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101750859 0 0) 0x7fbde0157810 con 0x7fbde0153e40 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdcc003570 con 0x7fbde0153e40 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/1919162378 >> v2:172.21.15.189:3300/0 conn(0x7fbde006e9c0 0x7fbde0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c37fe700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c41556f0 0x7f67c40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc06e620 0x7fcbbc1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc158fb0 0x7fcbbc152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcbbc15d910 0x7fcbbc06d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c8680 con 0x7fcbbc06e620 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c8c00 con 0x7fcbbc15d910 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc32ec700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc149f70 con 0x7fcbbc158fb0 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279164658 0 0) 0x7fbdcc003570 con 0x7fbde0153e40 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 >> v2:172.21.15.189:3300/0 conn(0x7fbde006e9c0 msgr2=0x7fbde0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 --2- 172.21.15.155:0/1919162378 >> v2:172.21.15.189:3300/0 conn(0x7fbde006e9c0 0x7fbde0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 >> v1:172.21.15.189:6789/0 conn(0x7fbde0153a70 legacy=0x7fbde0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde015a9e0 con 0x7fbde0153e40 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fbdd0001470 con 0x7fbde0153e40 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 >> v1:172.21.15.155:6789/0 conn(0x7fbde0153e40 legacy=0x7fbde006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdcc003a60 0x7fbdcc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbdcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdcc005210 0x7fbdcc00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde015a700 con 0x7fbdcc005210 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc00e3c0 con 0x7fbdcc003a60 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc00e580 con 0x7fbdcc004810 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 -- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c41556f0 msgr2=0x7f67c40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c41556f0 0x7f67c40b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 -- 172.21.15.155:0/866830012 >> v1:172.21.15.189:6789/0 conn(0x7f67c413e250 legacy=0x7f67c413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 -- 172.21.15.155:0/866830012 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4155d30 con 0x7f67c406e140 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 -- 172.21.15.155:0/3196059229 shutdown_connections 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 --2- 172.21.15.155:0/3196059229 >> v2:172.21.15.189:3300/0 conn(0x7fa87c167770 0x7fa87c167bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 --2- 172.21.15.155:0/3196059229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c06df10 0x7fa87c165ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 -- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159015d6d0 msgr2=0x7f1590067ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159015d6d0 0x7f1590067ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15840098e0 tx=0x7f15840091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 -- 172.21.15.155:0/3196059229 >> 172.21.15.155:0/3196059229 conn(0x7fa87c0678d0 msgr2=0x7fa87c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc1ae9700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc158fb0 0x7fcbbc152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc06e620 0x7fcbbc1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc1ae9700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc158fb0 0x7fcbbc152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:38536/0 (socket says 172.21.15.155:38536) 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc1ae9700 1 -- 172.21.15.155:0/4294527443 learned_addr learned my addr 172.21.15.155:0/4294527443 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc2aeb700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcbbc15d910 0x7fcbbc06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f6bfe687700 1 Processor -- start 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbdcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c3fff700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c406e140 0x7f67c406e510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b350 tx=0x7f67b4009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e852e1339140f91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 -- 172.21.15.155:0/3652430045 shutdown_connections 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159006f540 0x7f1590068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 --2- 172.21.15.155:0/3652430045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159015d6d0 0x7f1590067ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f15985b1700 1 -- 172.21.15.155:0/3652430045 >> 172.21.15.155:0/3652430045 conn(0x7f15900afbe0 msgr2=0x7f159006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde52d6700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdcc003a60 0x7fbdcc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdcc005210 0x7fbdcc00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fa882b65700 1 -- 172.21.15.155:0/3196059229 shutdown_connections 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f6bfe687700 1 -- start start 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 -- 172.21.15.155:0/4294527443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc158fb0 msgr2=0x7fcbbc152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcbbc158fb0 0x7fcbbc152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 -- 172.21.15.155:0/4294527443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcbbc15d910 msgr2=0x7fcbbc06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcbbc15d910 0x7fcbbc06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009ae0 con 0x7fcbbc06e620 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 -- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdcc003a60 msgr2=0x7fbdcc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbdcc003a60 0x7fbdcc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 -- 172.21.15.155:0/1919162378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdcc005210 msgr2=0x7fbdcc00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdcc005210 0x7fbdcc00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde4ad5700 1 -- 172.21.15.155:0/1919162378 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde015a9e0 con 0x7fbdcc004810 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fbde5ad7700 1 -- 172.21.15.155:0/1919162378 reap_dead start 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c2ffd700 1 -- 172.21.15.155:0/866830012 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b400be20 con 0x7f67c406e140 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c2ffd700 1 -- 172.21.15.155:0/866830012 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4011630 con 0x7f67c406e140 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7f67c2ffd700 1 -- 172.21.15.155:0/866830012 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40119d0 con 0x7f67c406e140 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.524+0000 7fcbc22ea700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc06e620 0x7fcbbc1493b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4015000 tx=0x7fcbb4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbdcc004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0007d00 tx=0x7fbdd00078f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d695b4b2a33f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000cc80 con 0x7fbdcc004810 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40089f0 con 0x7fcbbc06e620 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4008b50 con 0x7fcbbc06e620 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4026460 con 0x7fcbbc06e620 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc15bf10 con 0x7fcbbc06e620 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd000ce00 con 0x7fbdcc004810 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbdd7fff700 1 -- 172.21.15.155:0/1919162378 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00117b0 con 0x7fbdcc004810 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc15c4d0 con 0x7fcbbc06e620 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f15985b1700 1 -- 172.21.15.155:0/3652430045 shutdown_connections 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 -- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c406e140 msgr2=0x7f67c406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c406e140 0x7f67c406e510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b350 tx=0x7f67b4009ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfe687700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bf80adf10 0x7f6bf80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 -- 172.21.15.155:0/3196059229 wait complete. 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfe687700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfe687700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf80cb870 con 0x7f6bf806e470 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfe687700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf8158290 con 0x7f6bf80adf10 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfe687700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81610c0 con 0x7f6bf80cb450 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6bf80adf10 0x7f6bf80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf77fe700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f6bf806e470 0x7f6bf80cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46914/0 (socket says 172.21.15.155:46914) 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf77fe700 1 -- 172.21.15.155:0/1143097512 learned_addr learned my addr 172.21.15.155:0/1143097512 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 -- 172.21.15.155:0/866830012 shutdown_connections 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c41556f0 0x7f67c40b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 --2- 172.21.15.155:0/866830012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c406e140 0x7f67c406e510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 -- 172.21.15.155:0/866830012 >> 172.21.15.155:0/866830012 conn(0x7f67c40678d0 msgr2=0x7f67c4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f15985b1700 1 -- 172.21.15.155:0/3652430045 wait complete. 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 -- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 msgr2=0x7fbdcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbdcc004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0007d00 tx=0x7fbdd00078f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 -- 172.21.15.155:0/1919162378 shutdown_connections 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 --2- 172.21.15.155:0/1919162378 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbdcc004c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 -- 172.21.15.155:0/1919162378 >> 172.21.15.155:0/1919162378 conn(0x7fbde0067810 msgr2=0x7fbde0067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 -- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 msgr2=0x7f6bf806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfcc24700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 -- 172.21.15.155:0/1143097512 >> v1:172.21.15.189:6789/0 conn(0x7f6bf806e470 legacy=0x7f6bf80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 -- 172.21.15.155:0/1143097512 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80ae820 con 0x7f6bf80adf10 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bfcc24700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 -- 172.21.15.155:0/866830012 shutdown_connections 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcbbc0643a0 con 0x7fcbbc06e620 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 Processor -- start 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 -- start start 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 Processor -- start 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 -- start start 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 -- 172.21.15.155:0/866830012 wait complete. 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 -- 172.21.15.155:0/1919162378 shutdown_connections 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fbde753a700 1 -- 172.21.15.155:0/1919162378 wait complete. 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f15985b1700 1 Processor -- start 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f15985b1700 1 -- start start 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f930c14fc20 0x7f930c156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f930c0ae5d0 0x7f930c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c069a40 con 0x7f930c14f850 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c069d20 con 0x7f930c14fc20 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f9312429700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c06a000 con 0x7f930c0ae5d0 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f930b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f930c14fc20 0x7f930c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f930b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f930c14fc20 0x7f930c156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50114/0 (socket says 172.21.15.155:50114) 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f930b7fe700 1 -- 172.21.15.155:0/1606922066 learned_addr learned my addr 172.21.15.155:0/1606922066 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f930bfff700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f930c14f850 0x7f930c0691f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46922/0 (socket says 172.21.15.155:46922) 2024-08-17T02:27:31.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f67c9150700 1 Processor -- start 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 0x7fa87c160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87c06e2e0 0x7fa87c0ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930b7fe700 1 -- 172.21.15.155:0/1606922066 >> v2:172.21.15.189:3300/0 conn(0x7f930c0ae5d0 msgr2=0x7f930c0aa440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f6bf7fff700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80ae2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009e60 tx=0x7f6bf0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=107751c3d1554133 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c167770 0x7fa87c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0ab580 con 0x7fa87c06df10 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0c0a20 con 0x7fa87c06e2e0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7fa882b65700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0aa900 con 0x7fa87c167770 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930b7fe700 1 --2- 172.21.15.155:0/1606922066 >> v2:172.21.15.189:3300/0 conn(0x7f930c0ae5d0 0x7f930c0aa440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930b7fe700 1 -- 172.21.15.155:0/1606922066 >> v1:172.21.15.189:6789/0 conn(0x7f930c14f850 legacy=0x7f930c0691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930b7fe700 1 -- 172.21.15.155:0/1606922066 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c155ce0 con 0x7f930c14fc20 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa882364700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c167770 0x7fa87c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881362700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87c06e2e0 0x7fa87c0ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 0x7fa87c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bf6ffd700 1 -- 172.21.15.155:0/1143097512 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000e070 con 0x7f6bf80adf10 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 0x7fa87c160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50122/0 (socket says 172.21.15.155:50122) 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 -- 172.21.15.155:0/667066099 learned_addr learned my addr 172.21.15.155:0/667066099 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 Processor -- start 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bf6ffd700 1 -- 172.21.15.155:0/1143097512 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000bc30 con 0x7f6bf80adf10 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bf6ffd700 1 -- 172.21.15.155:0/1143097512 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0012430 con 0x7f6bf80adf10 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 -- start start 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- start start 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67c406e140 0x7f67c41392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 0x7f67c41367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcbb4003040 con 0x7fcbbc06e620 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 -- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c167770 msgr2=0x7fa87c0ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa87c167770 0x7fa87c0ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 -- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87c06e2e0 msgr2=0x7fa87c0ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa87c06e2e0 0x7fa87c0ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87400c2c0 con 0x7fa87c06df10 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c41556f0 0x7f67c4136d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4139e70 con 0x7f67c406e140 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4154810 con 0x7f67c41556f0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4154af0 con 0x7f67c413e250 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.528+0000 7f15985b1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159006f540 0x7f159016eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159015d6d0 0x7f1590154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f159015daa0 0x7f159015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159016f050 con 0x7f159015daa0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159016e680 con 0x7f159006f540 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159015af70 con 0x7f159015d6d0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f159634d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159006f540 0x7f159016eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f159015daa0 0x7f159015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f159634d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159006f540 0x7f159016eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50258/0 (socket says 172.21.15.155:50258) 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f159634d700 1 -- 172.21.15.155:0/1937464329 learned_addr learned my addr 172.21.15.155:0/1937464329 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1595b4c700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159015d6d0 0x7f1590154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 -- 172.21.15.155:0/1937464329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159015d6d0 msgr2=0x7f1590154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f159015d6d0 0x7f1590154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 -- 172.21.15.155:0/1937464329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159006f540 msgr2=0x7f159016eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f159006f540 0x7f159016eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584009420 con 0x7f159015daa0 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 0x7f67c41367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 0x7f67c41367f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:38584/0 (socket says 172.21.15.155:38584) 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 -- 172.21.15.155:0/2135401649 learned_addr learned my addr 172.21.15.155:0/2135401649 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c894f700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c41556f0 0x7f67c4136d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fbde753a700 1 Processor -- start 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa881b63700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 0x7fa87c160650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c290 tx=0x7fa87401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fcba00608e0 0x7fcba0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fbde753a700 1 -- start start 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 -- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 msgr2=0x7f6bf80ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80ae2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009e60 tx=0x7f6bf0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 -- 172.21.15.155:0/1143097512 shutdown_connections 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbb407eda0 con 0x7fcbbc06e620 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 --2- 172.21.15.155:0/1143097512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80ae2e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 -- 172.21.15.155:0/1143097512 >> 172.21.15.155:0/1143097512 conn(0x7f6bf8067810 msgr2=0x7f6bf8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7fcba0068af0 0x7fcba006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcba006b5b0 con 0x7fcba0068af0 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb407f0d0 con 0x7fcbbc06e620 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 -- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c41556f0 msgr2=0x7f67c4136d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67c41556f0 0x7f67c4136d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 -- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67c406e140 msgr2=0x7f67c41392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67c406e140 0x7f67c41392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009d80 con 0x7f67c413e250 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f1596b4e700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f159015daa0 0x7f159015a440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1588005c50 tx=0x7f1588001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 0x7f313c04fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f313c04ffb0 0x7f313c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874020070 con 0x7fa87c06df10 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c37fe700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 0x7f67c41367f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d860 tx=0x7f67b8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80125f0 con 0x7f67c413e250 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8012750 con 0x7f67c413e250 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8012b10 con 0x7f67c413e250 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4154dd0 con 0x7f67c413e250 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f67c9150700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c41397e0 con 0x7f67c413e250 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800a850 con 0x7f159015daa0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800a9b0 con 0x7f159015daa0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800ad70 con 0x7f159015daa0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159016e070 con 0x7f159015daa0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159015ac90 con 0x7f159015daa0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbc1ae9700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fcba00608e0 0x7fcba0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbc2aeb700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7fcba0068af0 0x7fcba006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbc2aeb700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7fcba0068af0 0x7fcba006af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930b7fe700 1 --2- 172.21.15.155:0/1606922066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c14fc20 0x7f930c156200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9304009f20 tx=0x7f9304009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15dfad6fc89ddfc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 -- 172.21.15.155:0/1143097512 shutdown_connections 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c0aabe0 con 0x7fa87c06df10 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c0ab1a0 con 0x7fa87c06df10 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87401a450 con 0x7fa87c06df10 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87401a830 con 0x7fa87c06df10 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c006cc0 con 0x7f313c0064d0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313c037640 con 0x7f313c04ffb0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3143fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c006fa0 con 0x7f313c0e0a80 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f31437fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f313c0064d0 0x7f313c0ea0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49354/0 (socket says 172.21.15.155:49354) 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f31437fe700 1 -- 172.21.15.155:0/4032536410 learned_addr learned my addr 172.21.15.155:0/4032536410 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3142ffd700 1 --2- 172.21.15.155:0/4032536410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 0x7f313c04fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3142ffd700 1 -- 172.21.15.155:0/4032536410 >> v2:172.21.15.155:3300/0 conn(0x7f313c04ffb0 msgr2=0x7f313c005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3142ffd700 1 --2- 172.21.15.155:0/4032536410 >> v2:172.21.15.155:3300/0 conn(0x7f313c04ffb0 0x7f313c005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3142ffd700 1 -- 172.21.15.155:0/4032536410 >> v1:172.21.15.155:6789/0 conn(0x7f313c0064d0 legacy=0x7f313c0ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930affd700 1 -- 172.21.15.155:0/1606922066 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930400e070 con 0x7f930c14fc20 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7fcbc1ae9700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fcba00608e0 0x7fcba0062d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0b0e70 tx=0x7fcbac007f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930affd700 1 -- 172.21.15.155:0/1606922066 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930400b980 con 0x7f930c14fc20 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f930affd700 1 -- 172.21.15.155:0/1606922066 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93040092e0 con 0x7f930c14fc20 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa85c000fd0 con 0x7fa87c06df10 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbde013e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbde00969f0 0x7fbde0096e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbde0069d30 0x7fbde006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0150750 con 0x7fbde00969f0 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde013ee50 con 0x7fbde0069d30 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde006a6e0 con 0x7fbdcc004810 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbde013e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbde013e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:38590/0 (socket says 172.21.15.155:38590) 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 -- 172.21.15.155:0/895979412 learned_addr learned my addr 172.21.15.155:0/895979412 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbde0069d30 0x7fbde006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f6bfe687700 1 -- 172.21.15.155:0/1143097512 wait complete. 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 -- 172.21.15.155:0/1606922066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c14fc20 msgr2=0x7f930c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 --2- 172.21.15.155:0/1606922066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c14fc20 0x7f930c156200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9304009f20 tx=0x7f9304009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67c9150700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67a4000fd0 con 0x7f67c413e250 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== osd.2 v2:172.21.15.155:6811/24220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcba006b5b0 con 0x7fcba0068af0 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 -- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbde0069d30 msgr2=0x7fbde006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbde0069d30 0x7fbde006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 -- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbde00969f0 msgr2=0x7fbde0096e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbde00969f0 0x7fbde0096e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 -- 172.21.15.155:0/895979412 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde01508e0 con 0x7fbdcc004810 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbde0069d30 0x7fbde006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15900645c0 con 0x7f159015daa0 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 Processor -- start 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde52d6700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbde013e910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00ec40 tx=0x7fbddc007e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 -- start start 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00c8b0 con 0x7fbdcc004810 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f67b801e460 con 0x7f67c413e250 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67abfff700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f67b0060860 0x7f67b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67b807d1d0 con 0x7f67c413e250 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67c3fff700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f67b0060860 0x7f67b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67abfff700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7f67b00689f0 0x7f67b006ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67b006b4b0 con 0x7f67b00689f0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 -- 172.21.15.155:0/1606922066 shutdown_connections 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 --2- 172.21.15.155:0/1606922066 >> v2:172.21.15.189:3300/0 conn(0x7f930c0ae5d0 0x7f930c0aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 --2- 172.21.15.155:0/1606922066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c14fc20 0x7f930c156200 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 -- 172.21.15.155:0/1606922066 >> 172.21.15.155:0/1606922066 conn(0x7f930c068300 msgr2=0x7f930c0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde00b0e60 con 0x7fbdcc004810 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00ca10 con 0x7fbdcc004810 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67c894f700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7f67b00689f0 0x7f67b006ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 -- 172.21.15.155:0/1606922066 shutdown_connections 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67c3fff700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f67b0060860 0x7f67b0062d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b350 tx=0x7f67b4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bf806e470 0x7f6bf8158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f67c894f700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7f67b00689f0 0x7f67b006ae00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8159480 con 0x7f6bf806e470 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8159760 con 0x7f6bf80adf10 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfe687700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8159a40 con 0x7f6bf80cb450 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.532+0000 7f3142ffd700 1 -- 172.21.15.155:0/4032536410 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c007280 con 0x7f313c0e0a80 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f3142ffd700 1 --2- 172.21.15.155:0/4032536410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 0x7f313c04fa70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f312c0098e0 tx=0x7f312c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=129538fa3b4afca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f3141ffb700 1 -- 172.21.15.155:0/4032536410 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c009e80 con 0x7f313c0e0a80 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f3141ffb700 1 -- 172.21.15.155:0/4032536410 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c00b860 con 0x7f313c0e0a80 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f3141ffb700 1 -- 172.21.15.155:0/4032536410 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00bbe0 con 0x7f313c0e0a80 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa874024070 con 0x7fa87c06df10 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== osd.0 v2:172.21.15.155:6800/24217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f67b006b4b0 con 0x7f67b00689f0 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 -- 172.21.15.155:0/1606922066 wait complete. 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f9312429700 1 Processor -- start 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bf806e470 0x7f6bf8158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bf806e470 0x7f6bf8158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50166/0 (socket says 172.21.15.155:50166) 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf7fff700 1 -- 172.21.15.155:0/738498622 learned_addr learned my addr 172.21.15.155:0/738498622 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bfcc24700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 -- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 msgr2=0x7f6bf8155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bf80cb450 0x7f6bf8155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 -- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bf806e470 msgr2=0x7f6bf8158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bf806e470 0x7f6bf8158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f6bf77fe700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0009a20 con 0x7f6bf80adf10 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bf77fe700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80aaca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c7c0 tx=0x7f6be8007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8005b30 con 0x7f6bf80adf10 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8159d20 con 0x7f6bf80adf10 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00cdd0 con 0x7fbdcc004810 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde0097840 con 0x7fbdcc004810 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbddc0133e0 con 0x7fbdcc004810 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fa871ffb700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa8600609b0 0x7fa860062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa87407f350 con 0x7fa87c06df10 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa881362700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa8600609b0 0x7fa860062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa871ffb700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7fa860068bc0 0x7fa86006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa86006b680 con 0x7fa860068bc0 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa87407f680 con 0x7fa87c06df10 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbdd57fa700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbdc4060860 0x7fbdc4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbddc07c840 con 0x7fbdcc004810 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa882364700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7fa860068bc0 0x7fa86006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbdc4060860 0x7fbdc4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- start start 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 0x7f930c098380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930c14f850 0x7f930c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930c14fc20 0x7f930c150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0af5a0 con 0x7f930c0ae5d0 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c176290 con 0x7f930c14fc20 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c098cb0 con 0x7f930c14f850 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.536+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1588007300 con 0x7f159015daa0 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 0x7f930c098380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930b7fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930c14f850 0x7f930c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 0x7f930c098380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50176/0 (socket says 172.21.15.155:50176) 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 -- 172.21.15.155:0/4007602259 learned_addr learned my addr 172.21.15.155:0/4007602259 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf81563d0 con 0x7f6bf80adf10 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be8004830 con 0x7f6bf80adf10 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8005ea0 con 0x7f6bf80adf10 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f15827fc700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f15740609b0 0x7f1574062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f158807d930 con 0x7f159015daa0 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f93109c6700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930c14fc20 0x7f930c150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 -- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930c14f850 msgr2=0x7f930c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f930c14f850 0x7f930c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 -- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930c14fc20 msgr2=0x7f930c150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930c14fc20 0x7f930c150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 -- 172.21.15.155:0/4007602259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304009ae0 con 0x7f930c0ae5d0 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f93109c6700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f930c14fc20 0x7f930c150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbde4ad5700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbdc4060860 0x7fbdc4062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbde01686f0 tx=0x7fbdd0018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa882364700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7fa860068bc0 0x7fa86006afd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 -- 172.21.15.155:0/4032536410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 msgr2=0x7f313c04fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 --2- 172.21.15.155:0/4032536410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 0x7f313c04fa70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f312c0098e0 tx=0x7f312c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 -- 172.21.15.155:0/4032536410 shutdown_connections 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 --2- 172.21.15.155:0/4032536410 >> v2:172.21.15.155:3300/0 conn(0x7f313c04ffb0 0x7f313c005f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 --2- 172.21.15.155:0/4032536410 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c0e0a80 0x7f313c04fa70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 -- 172.21.15.155:0/4032536410 >> 172.21.15.155:0/4032536410 conn(0x7f313c00a030 msgr2=0x7f313c00a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 -- 172.21.15.155:0/4032536410 shutdown_connections 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f15827fc700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7f1574068bc0 0x7f157406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f157406b680 con 0x7f1574068bc0 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f158807dc60 con 0x7f159015daa0 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f930bfff700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 0x7f930c098380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f930000c760 tx=0x7f9300007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b804d580 con 0x7f67c413e250 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f1595b4c700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7f1574068bc0 0x7f157406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbde753a700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7fbde006d2a0 0x7fbde00af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 --> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbde0097f70 con 0x7fbde006d2a0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f1595b4c700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7f1574068bc0 0x7f157406afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300007300 con 0x7f930c0ae5d0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c098f90 con 0x7f930c0ae5d0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c0af230 con 0x7f930c0ae5d0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300007460 con 0x7f930c0ae5d0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bd8000fd0 con 0x7f6bf80adf10 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7fbde006d2a0 0x7fbde00af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa881362700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa8600609b0 0x7fa860062e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0ae360 tx=0x7fa878009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== osd.6 v2:172.21.15.189:6824/24446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa86006b680 con 0x7fa860068bc0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.540+0000 7f3143fff700 1 -- 172.21.15.155:0/4032536410 wait complete. 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== osd.1 v2:172.21.15.155:6824/24219 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f157406b680 con 0x7f1574068bc0 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6be8004cb0 con 0x7f6bf80adf10 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7fbde5ad7700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7fbde006d2a0 0x7fbde00af260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300004830 con 0x7f930c0ae5d0 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6be40608e0 0x7f6be4062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6be807bed0 con 0x7f6bf80adf10 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9300004c60 con 0x7f930c0ae5d0 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f6be4068af0 0x7f6be406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6be406b5b0 con 0x7f6be4068af0 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6be807e470 con 0x7f6bf80adf10 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f92f3fff700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f92f80608e0 0x7f92f8062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f930007c080 con 0x7f930c0ae5d0 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bfcc24700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f6be4068af0 0x7f6be406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== osd.5 v2:172.21.15.189:6800/24444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbde0097f70 con 0x7fbde006d2a0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bfcc24700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f6be4068af0 0x7f6be406af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 Processor -- start 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 -- start start 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f313c0064d0 0x7f313c0379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c04ffb0 0x7f313c0f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 0x7f313c0e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0f7ad0 con 0x7f313c0e0a80 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0f8c60 con 0x7f313c0064d0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3143fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0f8050 con 0x7f313c04ffb0 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f9312429700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f92ec0015f0 0x7f92ec003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 0x7f313c0e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 0x7f313c0e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50182/0 (socket says 172.21.15.155:50182) 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 -- 172.21.15.155:0/1993247078 learned_addr learned my addr 172.21.15.155:0/1993247078 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f93109c6700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f92ec0015f0 0x7f92ec003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3142ffd700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f313c0064d0 0x7f313c0379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== osd.4 v2:172.21.15.189:6808/24445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6be406b5b0 con 0x7f6be4068af0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f930b7fe700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f92f80608e0 0x7f92f8062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f93109c6700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f92ec0015f0 0x7f92ec003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 --> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92ec006b90 con 0x7f92ec0015f0 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 -- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c04ffb0 msgr2=0x7f313c0f7590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f313c04ffb0 0x7f313c0f7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 -- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f313c0064d0 msgr2=0x7f313c0379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f313c0064d0 0x7f313c0379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f31437fe700 1 -- 172.21.15.155:0/1993247078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c009420 con 0x7f313c0e0a80 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.544+0000 7f3142ffd700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f313c0064d0 0x7f313c0379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f31437fe700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 0x7f313c0e90f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3144065940 tx=0x7f3144066540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f930b7fe700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f92f80608e0 0x7f92f8062d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f930c0716c0 tx=0x7f9304016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f159634d700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f15740609b0 0x7f1574062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.548+0000 7f159634d700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f15740609b0 0x7f1574062e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f158400a010 tx=0x7f1584016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.552+0000 7f6bf7fff700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6be40608e0 0x7f6be4062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.552+0000 7f6bf7fff700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6be40608e0 0x7f6be4062d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000bfa0 tx=0x7f6bf0019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.556+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== osd.3 v2:172.21.15.155:6808/24221 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f92ec006b90 con 0x7f92ec0015f0 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.556+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31440708e0 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.556+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144070a40 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144070de0 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c0f8330 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c0f88f0 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f314406f360 con 0x7f313c0e0a80 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f313affd700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f31240608b0 0x7f3124062d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31440f3070 con 0x7f313c0e0a80 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.560+0000 7f3142ffd700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f31240608b0 0x7f3124062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.564+0000 7f3142ffd700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f31240608b0 0x7f3124062d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f313c005c30 tx=0x7f312c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.564+0000 7f67c9150700 1 -- 172.21.15.155:0/2135401649 --> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67a4002cf0 con 0x7f67b00689f0 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.564+0000 7f67abfff700 1 -- 172.21.15.155:0/2135401649 <== osd.0 v2:172.21.15.155:6800/24217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67a4002cf0 con 0x7f67b00689f0 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 --> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbde006efa0 con 0x7fbde006d2a0 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f3143fff700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f313c0e9630 0x7f313c003160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 --> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f313c052b00 con 0x7f313c0e9630 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7f67b00689f0 msgr2=0x7f67b006ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7f67b00689f0 0x7f67b006ae00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f67b0060860 msgr2=0x7f67b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f67b0060860 0x7f67b0062d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b350 tx=0x7f67b4017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 msgr2=0x7f67c41367f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 --2- 172.21.15.155:0/2135401649 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67c413e250 0x7f67c41367f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d860 tx=0x7f67b8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67c894f700 1 -- 172.21.15.155:0/2135401649 reap_dead start 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 shutdown_connections 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 >> 172.21.15.155:0/2135401649 conn(0x7f67c40678d0 msgr2=0x7f67c4069450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f31427fc700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f313c0e9630 0x7f313c003160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 shutdown_connections 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f67a9ffb700 1 -- 172.21.15.155:0/2135401649 wait complete. 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbdd57fa700 1 -- 172.21.15.155:0/895979412 <== osd.5 v2:172.21.15.189:6800/24444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbde006efa0 con 0x7fbde006d2a0 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 --> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa85c002c90 con 0x7fa860068bc0 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f31427fc700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f313c0e9630 0x7f313c003160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 --> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcbbc06f5f0 con 0x7fcba0068af0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 --> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f159016ded0 con 0x7f1574068bc0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7fbde006d2a0 msgr2=0x7fbde00af260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7fbde006d2a0 0x7fbde00af260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbdc4060860 msgr2=0x7fbdc4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbdc4060860 0x7fbdc4062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbde01686f0 tx=0x7fbdd0018000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 msgr2=0x7fbde013e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 --2- 172.21.15.155:0/895979412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbdcc004810 0x7fbde013e910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00ec40 tx=0x7fbddc007e20 comp rx=0 tx=0).stop 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde5ad7700 1 -- 172.21.15.155:0/895979412 reap_dead start 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa871ffb700 1 -- 172.21.15.155:0/667066099 <== osd.6 v2:172.21.15.189:6824/24446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa85c002c90 con 0x7fa860068bc0 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 shutdown_connections 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 >> 172.21.15.155:0/895979412 conn(0x7fbde0067810 msgr2=0x7fbde0158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15827fc700 1 -- 172.21.15.155:0/1937464329 <== osd.1 v2:172.21.15.155:6824/24219 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f159016ded0 con 0x7f1574068bc0 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 shutdown_connections 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fbde753a700 1 -- 172.21.15.155:0/895979412 wait complete. 2024-08-17T02:27:31.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7f1574068bc0 msgr2=0x7f157406afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7f1574068bc0 0x7f157406afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7fa860068bc0 msgr2=0x7fa86006afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7fa860068bc0 0x7fa86006afd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f15740609b0 msgr2=0x7f1574062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f15740609b0 0x7f1574062e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f158400a010 tx=0x7f1584016000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f159015daa0 msgr2=0x7f159015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 --2- 172.21.15.155:0/1937464329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f159015daa0 0x7f159015a440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1588005c50 tx=0x7f1588001a20 comp rx=0 tx=0).stop 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f1596b4e700 1 -- 172.21.15.155:0/1937464329 reap_dead start 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 shutdown_connections 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa8600609b0 msgr2=0x7fa860062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa8600609b0 0x7fa860062e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0ae360 tx=0x7fa878009040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 msgr2=0x7fa87c160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 --2- 172.21.15.155:0/667066099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa87c06df10 0x7fa87c160650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c290 tx=0x7fa87401a000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 >> 172.21.15.155:0/1937464329 conn(0x7f15900afbe0 msgr2=0x7f15900670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== osd.7 v2:172.21.15.189:6810/24447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f313c052b00 con 0x7f313c0e9630 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882364700 1 -- 172.21.15.155:0/667066099 reap_dead start 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 shutdown_connections 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 >> 172.21.15.155:0/667066099 conn(0x7fa87c0678d0 msgr2=0x7fa87c162580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 shutdown_connections 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7f15985b1700 1 -- 172.21.15.155:0/1937464329 wait complete. 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 shutdown_connections 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.568+0000 7fa882b65700 1 -- 172.21.15.155:0/667066099 wait complete. 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7fcbb27fc700 1 -- 172.21.15.155:0/4294527443 <== osd.2 v2:172.21.15.155:6811/24220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcbbc06f5f0 con 0x7fcba0068af0 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7fcba0068af0 msgr2=0x7fcba006af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7fcba0068af0 0x7fcba006af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fcba00608e0 msgr2=0x7fcba0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fcba00608e0 0x7fcba0062d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0b0e70 tx=0x7fcbac007f50 comp rx=0 tx=0).stop 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc06e620 msgr2=0x7fcbbc1493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 --2- 172.21.15.155:0/4294527443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbbc06e620 0x7fcbbc1493b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4015000 tx=0x7fcbb4018000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc2aeb700 1 -- 172.21.15.155:0/4294527443 reap_dead start 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 shutdown_connections 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 --> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bd8002d30 con 0x7f6be4068af0 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bdffff700 1 -- 172.21.15.155:0/738498622 <== osd.4 v2:172.21.15.189:6808/24445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bd8002d30 con 0x7f6be4068af0 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f6be4068af0 msgr2=0x7f6be406af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f6be4068af0 0x7f6be406af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6be40608e0 msgr2=0x7f6be4062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6be40608e0 0x7f6be4062d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000bfa0 tx=0x7f6bf0019000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 msgr2=0x7f6bf80aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 --2- 172.21.15.155:0/738498622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bf80adf10 0x7f6bf80aaca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c7c0 tx=0x7f6be8007eb0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfcc24700 1 -- 172.21.15.155:0/738498622 reap_dead start 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 shutdown_connections 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 >> 172.21.15.155:0/738498622 conn(0x7f6bf8067810 msgr2=0x7f6bf806a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 shutdown_connections 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.572+0000 7f6bfe687700 1 -- 172.21.15.155:0/738498622 wait complete. 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 >> 172.21.15.155:0/4294527443 conn(0x7fcbbc0678d0 msgr2=0x7fcbbc0635b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 shutdown_connections 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.576+0000 7fcbc32ec700 1 -- 172.21.15.155:0/4294527443 wait complete. 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.580+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 --> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92ec005c80 con 0x7f92ec0015f0 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi155.stdout:60129542151 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f92f3fff700 1 -- 172.21.15.155:0/4007602259 <== osd.3 v2:172.21.15.155:6808/24221 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92ec005c80 con 0x7f92ec0015f0 2024-08-17T02:27:31.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f92ec0015f0 msgr2=0x7f92ec003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f92ec0015f0 0x7f92ec003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f92f80608e0 msgr2=0x7f92f8062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f92f80608e0 0x7f92f8062d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f930c0716c0 tx=0x7f9304016000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 msgr2=0x7f930c098380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 --2- 172.21.15.155:0/4007602259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0ae5d0 0x7f930c098380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f930000c760 tx=0x7f9300007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f93109c6700 1 -- 172.21.15.155:0/4007602259 reap_dead start 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 shutdown_connections 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 >> 172.21.15.155:0/4007602259 conn(0x7f930c068300 msgr2=0x7f930c0ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 shutdown_connections 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.584+0000 7f9312429700 1 -- 172.21.15.155:0/4007602259 wait complete. 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:31.634 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:31.635 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:31.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi155.stdout:60129542152 2024-08-17T02:27:31.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 --> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f313c009030 con 0x7f313c0e9630 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f313affd700 1 -- 172.21.15.155:0/1993247078 <== osd.7 v2:172.21.15.189:6810/24447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f313c009030 con 0x7f313c0e9630 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f313c0e9630 msgr2=0x7f313c003160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f313c0e9630 0x7f313c003160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f31240608b0 msgr2=0x7f3124062d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f31240608b0 0x7f3124062d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f313c005c30 tx=0x7f312c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 msgr2=0x7f313c0e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 --2- 172.21.15.155:0/1993247078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0e0a80 0x7f313c0e90f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3144065940 tx=0x7f3144066540 comp rx=0 tx=0).stop 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f31437fe700 1 -- 172.21.15.155:0/1993247078 reap_dead start 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 shutdown_connections 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 >> 172.21.15.155:0/1993247078 conn(0x7f313c00a030 msgr2=0x7f313c0deea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 shutdown_connections 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.592+0000 7f3143fff700 1 -- 172.21.15.155:0/1993247078 wait complete. 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:31.639 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi155.stdout:60129542151 2024-08-17T02:27:31.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi155.stdout:60129542149 2024-08-17T02:27:31.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi155.stdout:60129542152 2024-08-17T02:27:31.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:31.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 Processor -- start 2024-08-17T02:27:31.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 -- start start 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f01a4158f20 0x7f01a40a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40aed60 con 0x7f01a41592f0 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01aa20e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f01a41592f0 0x7f01a415cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49362/0 (socket says 172.21.15.155:49362) 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01aa20e700 1 -- 172.21.15.155:0/2089288525 learned_addr learned my addr 172.21.15.155:0/2089288525 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a920c700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/2089288525 >> v2:172.21.15.189:3300/0 conn(0x7f01a4158f20 0x7f01a40a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40aa240 con 0x7f01a4158f20 2024-08-17T02:27:31.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40aa520 con 0x7f01a40a9da0 2024-08-17T02:27:31.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 -- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 msgr2=0x7f01a406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 -- 172.21.15.155:0/2089288525 >> v1:172.21.15.155:6789/0 conn(0x7f01a41592f0 legacy=0x7f01a415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 -- 172.21.15.155:0/2089288525 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40aa800 con 0x7f01a4158f20 2024-08-17T02:27:31.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a920c700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.812+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a4158f20 0x7f01a40a9860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f019c009e60 tx=0x7f019c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f98735f657b21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01a8a0b700 1 -- 172.21.15.155:0/2089288525 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00e070 con 0x7f01a4158f20 2024-08-17T02:27:31.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01a8a0b700 1 -- 172.21.15.155:0/2089288525 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00ba60 con 0x7f01a4158f20 2024-08-17T02:27:31.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01a8a0b700 1 -- 172.21.15.155:0/2089288525 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00be00 con 0x7f01a4158f20 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a4158f20 msgr2=0x7f01a40a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a4158f20 0x7f01a40a9860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f019c009e60 tx=0x7f019c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 shutdown_connections 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 --2- 172.21.15.155:0/2089288525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a4158f20 0x7f01a40a9860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 >> 172.21.15.155:0/2089288525 conn(0x7f01a40678d0 msgr2=0x7f01a4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 shutdown_connections 2024-08-17T02:27:31.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 -- 172.21.15.155:0/2089288525 wait complete. 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7fc1a759e700 1 Processor -- start 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f6029e10700 1 Processor -- start 2024-08-17T02:27:31.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7fc1a759e700 1 -- start start 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f01abc71700 1 Processor -- start 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a8066e00 0x7fc1a81553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a759e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1a8067270 0x7fc1a80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a8155e30 con 0x7fc1a80af4d0 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a759e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a80af8a0 con 0x7fc1a8067270 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f6029e10700 1 -- start start 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a8156110 con 0x7fc1a8066e00 2024-08-17T02:27:31.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f113617c700 1 Processor -- start 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.816+0000 7f113617c700 1 -- start start 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1a8067270 0x7fc1a80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc1a8067270 0x7fc1a80686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50366/0 (socket says 172.21.15.155:50366) 2024-08-17T02:27:31.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 -- 172.21.15.155:0/1529401769 learned_addr learned my addr 172.21.15.155:0/1529401769 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113617c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f113006e140 0x7f113006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113617c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11301556f0 0x7f113013e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113617c700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130156940 con 0x7f113006aff0 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6029e10700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f60240b0d20 0x7f602406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6029e10700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 0x7f60240b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6029e10700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6024141a00 con 0x7f60240b1630 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6029e10700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602406e8a0 con 0x7f60240b0d20 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6029e10700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6024140b10 con 0x7f602406e450 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113617c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130155d30 con 0x7f11301556f0 2024-08-17T02:27:31.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113617c700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130156010 con 0x7f113006e140 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- start start 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a416d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 0x7f01a414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414b500 con 0x7f01a4158f20 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415c2b0 con 0x7f01a41592f0 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4159840 con 0x7f01a40a9da0 2024-08-17T02:27:31.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f602960f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f60240b1630 0x7f60241610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49372/0 (socket says 172.21.15.155:49372) 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f602960f700 1 -- 172.21.15.155:0/3480610669 learned_addr learned my addr 172.21.15.155:0/3480610669 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f1134979700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f113006aff0 0x7f11300b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46930/0 (socket says 172.21.15.155:46930) 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11301556f0 0x7f113013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50196/0 (socket says 172.21.15.155:50196) 2024-08-17T02:27:31.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 -- 172.21.15.155:0/3344445522 learned_addr learned my addr 172.21.15.155:0/3344445522 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f1134979700 1 -- 172.21.15.155:0/648045905 learned_addr learned my addr 172.21.15.155:0/648045905 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113517a700 1 --2- 172.21.15.155:0/648045905 >> v2:172.21.15.189:3300/0 conn(0x7f113006e140 0x7f113006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01aa20e700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 0x7f01a414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a416d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 -- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a8066e00 msgr2=0x7fc1a81553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a5d9b700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a8066e00 0x7fc1a81553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a8066e00 0x7fc1a81553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 -- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 msgr2=0x7f01a416d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a416d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 -- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 msgr2=0x7f01a414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 0x7f01a414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 -- 172.21.15.155:0/3344445522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0009420 con 0x7f01a4158f20 2024-08-17T02:27:31.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01aa20e700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 0x7f01a414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 --2- 172.21.15.155:0/3480610669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 0x7f60240b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618459167 0 0) 0x7f6024141a00 con 0x7f60240b1630 2024-08-17T02:27:31.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 -- 172.21.15.155:0/1529401769 >> v1:172.21.15.155:6789/0 conn(0x7fc1a80af4d0 legacy=0x7fc1a80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 -- 172.21.15.155:0/1529401769 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a81563f0 con 0x7fc1a8067270 2024-08-17T02:27:31.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01a920c700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01a000ec80 tx=0x7f01a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 -- 172.21.15.155:0/648045905 >> v2:172.21.15.189:3300/0 conn(0x7f113006e140 msgr2=0x7f113006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 --2- 172.21.15.155:0/648045905 >> v2:172.21.15.189:3300/0 conn(0x7f113006e140 0x7f113006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 -- 172.21.15.155:0/648045905 >> v1:172.21.15.189:6789/0 conn(0x7f113006aff0 legacy=0x7f11300b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 -- 172.21.15.155:0/648045905 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11301562f0 con 0x7f11301556f0 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c003570 con 0x7f60240b1630 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6028e0e700 1 --2- 172.21.15.155:0/3480610669 >> v2:172.21.15.189:3300/0 conn(0x7f60240b0d20 0x7f602406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000c9d0 con 0x7f01a4158f20 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000cb30 con 0x7f01a4158f20 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0013470 con 0x7f01a4158f20 2024-08-17T02:27:31.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- 172.21.15.155:0/3344445522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c009a20 con 0x7f01a4158f20 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f113597b700 1 --2- 172.21.15.155:0/648045905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11301556f0 0x7f113013e250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1130064e60 tx=0x7f112c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f9f43f363f2e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 -- 172.21.15.155:0/3480610669 >> v2:172.21.15.189:3300/0 conn(0x7f60240b0d20 msgr2=0x7f602406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 --2- 172.21.15.155:0/3480610669 >> v2:172.21.15.189:3300/0 conn(0x7f60240b0d20 0x7f602406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 -- 172.21.15.155:0/3480610669 >> v1:172.21.15.155:6789/0 conn(0x7f60240b1630 legacy=0x7f60241610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651602475 0 0) 0x7f600c003570 con 0x7f60240b1630 2024-08-17T02:27:31.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a6d9d700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8067270 0x7fc1a80686a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009f50 tx=0x7fc1a0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d147894a99f23631 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 -- 172.21.15.155:0/3480610669 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024140df0 con 0x7f602406e450 2024-08-17T02:27:31.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f01abc71700 1 -- 172.21.15.155:0/3344445522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a415a120 con 0x7f01a4158f20 2024-08-17T02:27:31.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a559a700 1 -- 172.21.15.155:0/1529401769 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000e070 con 0x7fc1a8067270 2024-08-17T02:27:31.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fe5225ce700 1 Processor -- start 2024-08-17T02:27:31.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fe5225ce700 1 -- start start 2024-08-17T02:27:31.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f1127fff700 1 -- 172.21.15.155:0/648045905 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c011630 con 0x7f11301556f0 2024-08-17T02:27:31.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f1127fff700 1 -- 172.21.15.155:0/648045905 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c011790 con 0x7f11301556f0 2024-08-17T02:27:31.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f1127fff700 1 -- 172.21.15.155:0/648045905 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c011b30 con 0x7f11301556f0 2024-08-17T02:27:31.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7eff648c3700 1 Processor -- start 2024-08-17T02:27:31.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7eff648c3700 1 -- start start 2024-08-17T02:27:31.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7f6023fff700 1 --2- 172.21.15.155:0/3480610669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 0x7f60240b10f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60180098e0 tx=0x7f60180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8948e5947c8fb2ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a559a700 1 -- 172.21.15.155:0/1529401769 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a000ba30 con 0x7fc1a8067270 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.820+0000 7fc1a559a700 1 -- 172.21.15.155:0/1529401769 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00092e0 con 0x7fc1a8067270 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f01abc71700 1 -- 172.21.15.155:0/3344445522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40643a0 con 0x7f01a4158f20 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014001470 con 0x7f602406e450 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018011420 con 0x7f602406e450 2024-08-17T02:27:31.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f60237fe700 1 -- 172.21.15.155:0/3480610669 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180117a0 con 0x7f602406e450 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5225ce700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe514050540 0x7fe514005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5225ce700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5140538d0 con 0x7fe51404f260 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5225ce700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe514053410 con 0x7fe5140d8760 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5225ce700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5140df7d0 con 0x7fe514050540 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5215cc700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe5140d8760 0x7fe51404fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:46936/0 (socket says 172.21.15.155:46936) 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe5215cc700 1 -- 172.21.15.155:0/4247599822 learned_addr learned my addr 172.21.15.155:0/4247599822 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:31.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 -- 172.21.15.155:0/648045905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11301556f0 msgr2=0x7f113013e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 --2- 172.21.15.155:0/648045905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11301556f0 0x7f113013e250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1130064e60 tx=0x7f112c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8067270 msgr2=0x7fc1a80686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8067270 0x7fc1a80686a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009f50 tx=0x7fc1a0009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- 172.21.15.155:0/1529401769 shutdown_connections 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8067270 0x7fc1a80686a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1529401769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a8066e00 0x7fc1a81553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- 172.21.15.155:0/1529401769 >> 172.21.15.155:0/1529401769 conn(0x7fc1a806d800 msgr2=0x7fc1a806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe520dcb700 1 --2- 172.21.15.155:0/4247599822 >> v2:172.21.15.189:3300/0 conn(0x7fe514050540 0x7fe514005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff648c3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff600688d0 0x7eff60068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff648c3700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7eff600cc060 0x7eff600b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff648c3700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff600b1500 con 0x7eff600caa20 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff648c3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600cafc0 con 0x7eff600688d0 2024-08-17T02:27:31.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff648c3700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600cb2a0 con 0x7eff600cc060 2024-08-17T02:27:31.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 -- 172.21.15.155:0/648045905 shutdown_connections 2024-08-17T02:27:31.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 --2- 172.21.15.155:0/648045905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11301556f0 0x7f113013e250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 --2- 172.21.15.155:0/648045905 >> v2:172.21.15.189:3300/0 conn(0x7f113006e140 0x7f113006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7eff600cc060 0x7eff600b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 -- 172.21.15.155:0/648045905 >> 172.21.15.155:0/648045905 conn(0x7f11300678d0 msgr2=0x7f1130067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7eff600cc060 0x7eff600b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50408/0 (socket says 172.21.15.155:50408) 2024-08-17T02:27:31.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 -- 172.21.15.155:0/513674494 learned_addr learned my addr 172.21.15.155:0/513674494 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 -- 172.21.15.155:0/648045905 shutdown_connections 2024-08-17T02:27:31.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 -- 172.21.15.155:0/3480610669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 msgr2=0x7f60240b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 --2- 172.21.15.155:0/3480610669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 0x7f60240b10f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60180098e0 tx=0x7f60180091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 -- 172.21.15.155:0/3480610669 shutdown_connections 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 --2- 172.21.15.155:0/3480610669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f602406e450 0x7f60240b10f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 --2- 172.21.15.155:0/3480610669 >> v2:172.21.15.189:3300/0 conn(0x7f60240b0d20 0x7f602406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 -- 172.21.15.155:0/3480610669 >> 172.21.15.155:0/3480610669 conn(0x7f60240678d0 msgr2=0x7f6024067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe513fff700 1 -- 172.21.15.155:0/4247599822 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213987981 0 0) 0x7fe514053410 con 0x7fe5140d8760 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe513fff700 1 -- 172.21.15.155:0/4247599822 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe508003570 con 0x7fe5140d8760 2024-08-17T02:27:31.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 -- 172.21.15.155:0/648045905 wait complete. 2024-08-17T02:27:31.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 -- 172.21.15.155:0/3480610669 shutdown_connections 2024-08-17T02:27:31.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f01a0013820 con 0x7f01a4158f20 2024-08-17T02:27:31.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- 172.21.15.155:0/1529401769 shutdown_connections 2024-08-17T02:27:31.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- 172.21.15.155:0/1529401769 wait complete. 2024-08-17T02:27:31.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 -- 172.21.15.155:0/513674494 >> v2:172.21.15.155:3300/0 conn(0x7eff600688d0 msgr2=0x7eff60068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5e7fc700 1 -- 172.21.15.155:0/513674494 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563497045 0 0) 0x7eff600b1500 con 0x7eff600caa20 2024-08-17T02:27:31.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 --2- 172.21.15.155:0/513674494 >> v2:172.21.15.155:3300/0 conn(0x7eff600688d0 0x7eff60068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 -- 172.21.15.155:0/513674494 >> v1:172.21.15.189:6789/0 conn(0x7eff600caa20 legacy=0x7eff60156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 -- 172.21.15.155:0/513674494 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600cb580 con 0x7eff600cc060 2024-08-17T02:27:31.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f0199ffb700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 0x7f0188062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe520dcb700 1 -- 172.21.15.155:0/4247599822 >> v1:172.21.15.189:6789/0 conn(0x7fe5140d8760 legacy=0x7fe51404fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe520dcb700 1 -- 172.21.15.155:0/4247599822 >> v1:172.21.15.155:6789/0 conn(0x7fe51404f260 legacy=0x7fe514053d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01a007d200 con 0x7f01a4158f20 2024-08-17T02:27:31.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe520dcb700 1 -- 172.21.15.155:0/4247599822 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140def30 con 0x7fe514050540 2024-08-17T02:27:31.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5effd700 1 --2- 172.21.15.155:0/513674494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600b1f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff60070340 tx=0x7eff54009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530fbed4913542b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe520dcb700 1 --2- 172.21.15.155:0/4247599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe514050540 0x7fe514005eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0098e0 tx=0x7fe50c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd723fe1b9b9ecd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5e7fc700 1 -- 172.21.15.155:0/513674494 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400b860 con 0x7eff600cc060 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5e7fc700 1 -- 172.21.15.155:0/513674494 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400b9c0 con 0x7eff600cc060 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7eff5e7fc700 1 -- 172.21.15.155:0/513674494 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400b860 con 0x7eff600cc060 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe513fff700 1 -- 172.21.15.155:0/4247599822 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00b640 con 0x7fe514050540 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe513fff700 1 -- 172.21.15.155:0/4247599822 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00b7a0 con 0x7fe514050540 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fe513fff700 1 -- 172.21.15.155:0/4247599822 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00bb40 con 0x7fe514050540 2024-08-17T02:27:31.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- 172.21.15.155:0/4247599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe514050540 msgr2=0x7fe514005eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 --2- 172.21.15.155:0/4247599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe514050540 0x7fe514005eb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0098e0 tx=0x7fe50c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 Processor -- start 2024-08-17T02:27:31.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 -- start start 2024-08-17T02:27:31.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f113617c700 1 Processor -- start 2024-08-17T02:27:31.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7f6029e10700 1 -- 172.21.15.155:0/3480610669 wait complete. 2024-08-17T02:27:31.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 Processor -- start 2024-08-17T02:27:31.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.824+0000 7fc1a759e700 1 -- start start 2024-08-17T02:27:31.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- 172.21.15.155:0/4247599822 shutdown_connections 2024-08-17T02:27:31.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 --2- 172.21.15.155:0/4247599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe514050540 0x7fe514005eb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- 172.21.15.155:0/4247599822 >> 172.21.15.155:0/4247599822 conn(0x7fe514051690 msgr2=0x7fe514051a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- 172.21.15.155:0/4247599822 shutdown_connections 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- 172.21.15.155:0/4247599822 wait complete. 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 0x7fc1a81438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a80af4d0 0x7fc1a8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a8142ba0 con 0x7fc1a8067270 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a8143420 con 0x7fc1a8066e00 2024-08-17T02:27:31.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a81587a0 con 0x7fc1a80af4d0 2024-08-17T02:27:31.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 Processor -- start 2024-08-17T02:27:31.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 -- start start 2024-08-17T02:27:31.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 -- 172.21.15.155:0/513674494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 msgr2=0x7eff600b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 --2- 172.21.15.155:0/513674494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600b1f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff60070340 tx=0x7eff54009250 comp rx=0 tx=0).stop 2024-08-17T02:27:31.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 0x7f0188062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 -- start start 2024-08-17T02:27:31.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f01a9a0d700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 0x7f0188062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f019c0099a0 tx=0x7f019c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f113006aff0 0x7f113013b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7270156d80 0x7f7270157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72700b0d90 0x7f72700b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72701580e0 con 0x7f72700ad750 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700b1720 con 0x7f7270156d80 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7275fc1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72701577b0 con 0x7f72700b0d90 2024-08-17T02:27:31.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7270156d80 0x7f7270157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 0x7f6024145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 0x7f6024145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50410/0 (socket says 172.21.15.155:50410) 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 -- 172.21.15.155:0/1878716534 learned_addr learned my addr 172.21.15.155:0/1878716534 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a5d9b700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 0x7fc1a81438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 -- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a80af4d0 msgr2=0x7fc1a8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a80af4d0 0x7fc1a8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 -- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 msgr2=0x7fc1a81438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 0x7fc1a81438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 -- 172.21.15.155:0/1878716534 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009ae0 con 0x7fc1a8066e00 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a5d9b700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 0x7fc1a81438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1a659c700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b5e0 tx=0x7fc198009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7270156d80 0x7f7270157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50224/0 (socket says 172.21.15.155:50224) 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 -- 172.21.15.155:0/2501396119 learned_addr learned my addr 172.21.15.155:0/2501396119 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 -- 172.21.15.155:0/2501396119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72700b0d90 msgr2=0x7f72700b11e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:31.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 --2- 172.21.15.155:0/2501396119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72700b0d90 0x7f72700b11e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 -- 172.21.15.155:0/2501396119 >> v1:172.21.15.155:6789/0 conn(0x7f72700ad750 legacy=0x7f72700adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 -- 172.21.15.155:0/2501396119 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270157a90 con 0x7f7270156d80 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f7274fbf700 1 --2- 172.21.15.155:0/2501396119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7270156d80 0x7f7270157150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7268009f20 tx=0x7f7268009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eafc8669289c39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 -- 172.21.15.155:0/513674494 shutdown_connections 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 --2- 172.21.15.155:0/513674494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600b1f50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 --2- 172.21.15.155:0/513674494 >> v2:172.21.15.155:3300/0 conn(0x7eff600688d0 0x7eff60068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 -- 172.21.15.155:0/513674494 >> 172.21.15.155:0/513674494 conn(0x7eff6006d790 msgr2=0x7eff6006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 Processor -- start 2024-08-17T02:27:31.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fe5225ce700 1 -- start start 2024-08-17T02:27:31.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6028e0e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 0x7f6024145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6023fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 0x7f6024145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50252/0 (socket says 172.21.15.155:50252) 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6028e0e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 0x7f6024145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50426/0 (socket says 172.21.15.155:50426) 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 0x7f113013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113013b170 con 0x7f113006e140 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113013bb40 con 0x7f11301556f0 2024-08-17T02:27:31.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113617c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113013a560 con 0x7f113006aff0 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024145b40 con 0x7f60240b1630 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240a55f0 con 0x7f602406e450 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6029e10700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240a58d0 con 0x7f60240b0d20 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50240/0 (socket says 172.21.15.155:50240) 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 -- 172.21.15.155:0/571708217 learned_addr learned my addr 172.21.15.155:0/571708217 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113517a700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f113006aff0 0x7f113013b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f6023fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 0x7f6024145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:38676/0 (socket says 172.21.15.155:38676) 2024-08-17T02:27:31.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 -- 172.21.15.155:0/3165400573 learned_addr learned my addr 172.21.15.155:0/3165400573 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 -- 172.21.15.155:0/513674494 shutdown_connections 2024-08-17T02:27:31.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113597b700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 0x7f113013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7eff648c3700 1 -- 172.21.15.155:0/513674494 wait complete. 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 -- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f113006aff0 msgr2=0x7f113013b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f113006aff0 0x7f113013b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 -- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 msgr2=0x7f113013bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 0x7f113013bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 -- 172.21.15.155:0/571708217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009420 con 0x7f113006e140 2024-08-17T02:27:31.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 -- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 msgr2=0x7f6024145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 0x7f6024145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 -- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 msgr2=0x7f6024145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 0x7f6024145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 -- 172.21.15.155:0/3165400573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009420 con 0x7f60240b1630 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f113597b700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 0x7f113013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f1134979700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f112000c790 tx=0x7f1120007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7f602960f700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f60140019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.828+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800f510 con 0x7fc1a8066e00 2024-08-17T02:27:31.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19800f670 con 0x7fc1a8066e00 2024-08-17T02:27:31.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800fa30 con 0x7fc1a8066e00 2024-08-17T02:27:31.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a8158a80 con 0x7fc1a8066e00 2024-08-17T02:27:31.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f01a004d7b0 con 0x7f01a4158f20 2024-08-17T02:27:31.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f726f7fe700 1 -- 172.21.15.155:0/2501396119 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800e070 con 0x7f7270156d80 2024-08-17T02:27:31.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a81430b0 con 0x7fc1a8066e00 2024-08-17T02:27:31.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f726f7fe700 1 -- 172.21.15.155:0/2501396119 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726800ba80 con 0x7f7270156d80 2024-08-17T02:27:31.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f726f7fe700 1 -- 172.21.15.155:0/2501396119 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680092e0 con 0x7f7270156d80 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe514050540 0x7fe51404e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5140d8760 0x7fe51404c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51404eb90 con 0x7fe51404f260 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514039a20 con 0x7fe5140d8760 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5225ce700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140390f0 con 0x7fe514050540 2024-08-17T02:27:31.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 Processor -- start 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50254/0 (socket says 172.21.15.155:50254) 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 -- 172.21.15.155:0/2127322902 learned_addr learned my addr 172.21.15.155:0/2127322902 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 -- 172.21.15.155:0/2501396119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7270156d80 msgr2=0x7f7270157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 --2- 172.21.15.155:0/2501396119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7270156d80 0x7f7270157150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7268009f20 tx=0x7f7268009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 -- 172.21.15.155:0/2501396119 shutdown_connections 2024-08-17T02:27:31.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 --2- 172.21.15.155:0/2501396119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72700b0d90 0x7f72700b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 --2- 172.21.15.155:0/2501396119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7270156d80 0x7f7270157150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 -- 172.21.15.155:0/2501396119 >> 172.21.15.155:0/2501396119 conn(0x7f72700678d0 msgr2=0x7f7270067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014007360 con 0x7f60240b1630 2024-08-17T02:27:31.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120005b30 con 0x7f113006e140 2024-08-17T02:27:31.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 -- start start 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a80638f0 con 0x7fc1a8066e00 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 -- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe514050540 msgr2=0x7fe51404e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe514050540 0x7fe51404e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 -- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5140d8760 msgr2=0x7fe51404c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5140d8760 0x7fe51404c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 -- 172.21.15.155:0/2127322902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c009420 con 0x7fe51404f260 2024-08-17T02:27:31.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120005cb0 con 0x7f113006e140 2024-08-17T02:27:31.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120004a80 con 0x7f113006e140 2024-08-17T02:27:31.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc19801a400 con 0x7fc1a8066e00 2024-08-17T02:27:31.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fe5215cc700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c590 tx=0x7fe518007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff600688d0 0x7eff6013b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 0x7eff60142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60145d80 con 0x7eff600caa20 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600abdc0 con 0x7eff600cc060 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff648c3700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff601457c0 con 0x7eff600688d0 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:50446/0 (socket says 172.21.15.155:50446) 2024-08-17T02:27:31.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5ffff700 1 -- 172.21.15.155:0/2117821408 learned_addr learned my addr 172.21.15.155:0/2117821408 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5f7fe700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff600688d0 0x7eff6013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 0x7eff60142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60140074e0 con 0x7f60240b1630 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004830 con 0x7f60240b1630 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240a5bb0 con 0x7f60240b1630 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024146430 con 0x7f60240b1630 2024-08-17T02:27:31.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240643a0 con 0x7f60240b1630 2024-08-17T02:27:31.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113013a840 con 0x7f113006e140 2024-08-17T02:27:31.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113013ae00 con 0x7f113006e140 2024-08-17T02:27:31.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1967fc700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 0x7fc188062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc19807cc30 con 0x7fc1a8066e00 2024-08-17T02:27:31.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7fc1a5d9b700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 0x7fc188062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 -- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff600688d0 msgr2=0x7eff6013b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff600688d0 0x7eff6013b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 -- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 msgr2=0x7eff600ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7eff5effd700 1 -- 172.21.15.155:0/2117821408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540094f0 con 0x7eff600caa20 2024-08-17T02:27:31.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.832+0000 7f7275fc1700 1 -- 172.21.15.155:0/2501396119 shutdown_connections 2024-08-17T02:27:31.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fc1a5d9b700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 0x7fc188062de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8154980 tx=0x7fc19c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518005b30 con 0x7fe51404f260 2024-08-17T02:27:31.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 -- 172.21.15.155:0/2501396119 wait complete. 2024-08-17T02:27:31.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113013b320 con 0x7f113006e140 2024-08-17T02:27:31.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518005cb0 con 0x7fe51404f260 2024-08-17T02:27:31.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518007320 con 0x7fe51404f260 2024-08-17T02:27:31.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6014004be0 con 0x7f60240b1630 2024-08-17T02:27:31.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f6020ff9700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 0x7f6010062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f601407c750 con 0x7f60240b1630 2024-08-17T02:27:31.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5140393d0 con 0x7fe51404f260 2024-08-17T02:27:31.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5140d5bf0 con 0x7fe51404f260 2024-08-17T02:27:31.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 Processor -- start 2024-08-17T02:27:31.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7eff5effd700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 0x7eff60142ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff54013000 tx=0x7eff54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 Processor -- start 2024-08-17T02:27:31.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 -- start start 2024-08-17T02:27:31.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f6028e0e700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 0x7f6010062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 -- start start 2024-08-17T02:27:31.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f6028e0e700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 0x7f6010062de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f602416f100 tx=0x7f601c0077f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08c81593b0 0x7f08c815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 0x7f08c80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80acae0 con 0x7f08c815a8b0 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80ac650 con 0x7f08c81593b0 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08cda9d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8159780 con 0x7f08c80aab50 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72700ad750 0x7f727016e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7270156d80 0x7f72701405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b0bd0 con 0x7f72700b0d90 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b0950 con 0x7f72700ad750 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7275fc1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7270171190 con 0x7f7270156d80 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08c81593b0 0x7f08c815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08c81593b0 0x7f08c815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50278/0 (socket says 172.21.15.155:50278) 2024-08-17T02:27:31.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 -- 172.21.15.155:0/1512094031 learned_addr learned my addr 172.21.15.155:0/1512094031 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f726ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f726ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50286/0 (socket says 172.21.15.155:50286) 2024-08-17T02:27:31.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f726ffff700 1 -- 172.21.15.155:0/4130019157 learned_addr learned my addr 172.21.15.155:0/4130019157 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c7fff700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 0x7f08c80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5140053b0 con 0x7fe51404f260 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f72757c0700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7270156d80 0x7f72701405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 -- 172.21.15.155:0/1512094031 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 msgr2=0x7f08c80b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 0x7f08c80b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 -- 172.21.15.155:0/1512094031 >> v1:172.21.15.189:6789/0 conn(0x7f08c815a8b0 legacy=0x7f08c80aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 -- 172.21.15.155:0/1512094031 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80aba40 con 0x7f08c81593b0 2024-08-17T02:27:31.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c7fff700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 0x7f08c80b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f7274fbf700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72700ad750 0x7f727016e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.836+0000 7f08c77fe700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c81593b0 0x7f08c815a370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0099b0 tx=0x7f08bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a014a9d6d9af65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 -- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7270156d80 msgr2=0x7f72701405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7270156d80 0x7f72701405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 -- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72700ad750 msgr2=0x7f727016e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72700ad750 0x7f727016e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 -- 172.21.15.155:0/4130019157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009ae0 con 0x7f72700b0d90 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726ffff700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f726400b600 tx=0x7f72640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f601404cc70 con 0x7f60240b1630 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f08c67fc700 1 -- 172.21.15.155:0/1512094031 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00b860 con 0x7f08c81593b0 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f08c67fc700 1 -- 172.21.15.155:0/1512094031 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc00b9c0 con 0x7f08c81593b0 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f08c67fc700 1 -- 172.21.15.155:0/1512094031 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00bd60 con 0x7f08c81593b0 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400f510 con 0x7f72700b0d90 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400f690 con 0x7f72700b0d90 2024-08-17T02:27:31.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400fa50 con 0x7f72700b0d90 2024-08-17T02:27:31.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1120005030 con 0x7f113006e140 2024-08-17T02:27:31.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7270143bd0 con 0x7f72700b0d90 2024-08-17T02:27:31.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f08cda9d700 1 -- 172.21.15.155:0/1512094031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c81593b0 msgr2=0x7f08c815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.840+0000 7f08cda9d700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c81593b0 0x7f08c815a370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0099b0 tx=0x7f08bc009250 comp rx=0 tx=0).stop 2024-08-17T02:27:31.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7270144190 con 0x7f72700b0d90 2024-08-17T02:27:31.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f11257fa700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 0x7f1114062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe51801b3b0 con 0x7fe51404f260 2024-08-17T02:27:31.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f112007cad0 con 0x7f113006e140 2024-08-17T02:27:31.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400b860 con 0x7eff600caa20 2024-08-17T02:27:31.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- 172.21.15.155:0/1512094031 shutdown_connections 2024-08-17T02:27:31.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c80aab50 0x7f08c80b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 --2- 172.21.15.155:0/1512094031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c81593b0 0x7f08c815a370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- 172.21.15.155:0/1512094031 >> 172.21.15.155:0/1512094031 conn(0x7f08c8068300 msgr2=0x7f08c80a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5401ae60 con 0x7eff600caa20 2024-08-17T02:27:31.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54011690 con 0x7eff600caa20 2024-08-17T02:27:31.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7fe5117fa700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 0x7fe500062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe51807c620 con 0x7fe51404f260 2024-08-17T02:27:31.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7fe520dcb700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 0x7fe500062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff60145aa0 con 0x7eff600caa20 2024-08-17T02:27:31.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6013b5a0 con 0x7eff600caa20 2024-08-17T02:27:31.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72701713b0 con 0x7f72700b0d90 2024-08-17T02:27:31.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f113517a700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 0x7f1114062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7fe520dcb700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 0x7fe500062d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe514050940 tx=0x7fe50c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- 172.21.15.155:0/1512094031 shutdown_connections 2024-08-17T02:27:31.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- 172.21.15.155:0/1512094031 wait complete. 2024-08-17T02:27:31.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f113517a700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 0x7f1114062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11280076a0 tx=0x7f112800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 Processor -- start 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- start start 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c81593b0 0x7f08c80970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 0x7f08c8097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80b0a00 con 0x7f08c80aab50 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80afdf0 con 0x7f08c81593b0 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08cda9d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80b00d0 con 0x7f08c815a8b0 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08c77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08c77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50298/0 (socket says 172.21.15.155:50298) 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.844+0000 7f08c77fe700 1 -- 172.21.15.155:0/4089811849 learned_addr learned my addr 172.21.15.155:0/4089811849 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:31.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600643a0 con 0x7eff600caa20 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc19804d1e0 con 0x7fc1a8066e00 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c7fff700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 0x7f08c8097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c6ffd700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c81593b0 0x7f08c80970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 -- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 msgr2=0x7f08c8097620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 0x7f08c8097620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 -- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c81593b0 msgr2=0x7f08c80970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c81593b0 0x7f08c80970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 -- 172.21.15.155:0/4089811849 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0094f0 con 0x7f08c80aab50 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c7fff700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 0x7f08c8097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f08c77fe700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009290 tx=0x7f08bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.848+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f112004cfa0 con 0x7f113006e140 2024-08-17T02:27:31.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe51804ca50 con 0x7fe51404f260 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7eff54011a40 con 0x7eff600caa20 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7eff477fe700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 0x7eff4c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7264024430 con 0x7f72700b0d90 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7f726cff9700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 0x7f725c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f726407ce90 con 0x7f72700b0d90 2024-08-17T02:27:31.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7eff5f7fe700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 0x7eff4c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.860+0000 7f7274fbf700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 0x7f725c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7eff5f7fe700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 0x7eff4c062de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff50009bf0 tx=0x7eff500091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff54053330 con 0x7eff600caa20 2024-08-17T02:27:31.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f7274fbf700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 0x7f725c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7268009880 tx=0x7f7268018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc026480 con 0x7f08c80aab50 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc01f070 con 0x7f08c80aab50 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f08cda9d700 1 -- 172.21.15.155:0/4089811849 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c80b03b0 con 0x7f08c80aab50 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f08cda9d700 1 -- 172.21.15.155:0/4089811849 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c81558e0 con 0x7f08c80aab50 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.864+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc026830 con 0x7f08c80aab50 2024-08-17T02:27:31.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.868+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8070360 con 0x7f08c80aab50 2024-08-17T02:27:31.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.868+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7eff5404ef30 con 0x7eff600caa20 2024-08-17T02:27:31.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.876+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f726404d440 con 0x7f72700b0d90 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.880+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f08bc026ba0 con 0x7f08c80aab50 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.880+0000 7f08af7fe700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 0x7f08b4062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.880+0000 7f08c6ffd700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 0x7f08b4062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.880+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08bc021070 con 0x7f08c80aab50 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.880+0000 7f08c6ffd700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 0x7f08b4062e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08c815bed0 tx=0x7f08b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:31.888+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f08bc04f040 con 0x7f08c80aab50 2024-08-17T02:27:32.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.116+0000 7f01abc71700 1 -- 172.21.15.155:0/3344445522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f01a406f5f0 con 0x7f01a4158f20 2024-08-17T02:27:32.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.116+0000 7f0199ffb700 1 -- 172.21.15.155:0/3344445522 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01a0050dd0 con 0x7f01a4158f20 2024-08-17T02:27:32.122 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 msgr2=0x7f0188062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 0x7f0188062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f019c0099a0 tx=0x7f019c018000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 msgr2=0x7f01a414f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01a000ec80 tx=0x7f01a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 shutdown_connections 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0188060930 0x7f0188062de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01a41592f0 0x7f01a414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a4158f20 0x7f01a414f7e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 --2- 172.21.15.155:0/3344445522 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01a40a9da0 0x7f01a416d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 >> 172.21.15.155:0/3344445522 conn(0x7f01a40678d0 msgr2=0x7f01a406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 shutdown_connections 2024-08-17T02:27:32.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.124+0000 7f01877fe700 1 -- 172.21.15.155:0/3344445522 wait complete. 2024-08-17T02:27:32.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-08-17T02:27:32.141 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.140+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f602406f5f0 con 0x7f60240b1630 2024-08-17T02:27:32.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.140+0000 7f6020ff9700 1 -- 172.21.15.155:0/3165400573 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6014018020 con 0x7f60240b1630 2024-08-17T02:27:32.144 INFO:teuthology.orchestra.run.smithi155.stdout:60129542151 2024-08-17T02:27:32.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 msgr2=0x7f6010062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 0x7f6010062de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f602416f100 tx=0x7f601c0077f0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 msgr2=0x7f60240a6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f60140019d0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 shutdown_connections 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6010060930 0x7f6010062de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1630 0x7f60240a6b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f60240b0d20 0x7f6024145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 --2- 172.21.15.155:0/3165400573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f602406e450 0x7f6024145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 >> 172.21.15.155:0/3165400573 conn(0x7f60240678d0 msgr2=0x7f602415e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 shutdown_connections 2024-08-17T02:27:32.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.144+0000 7f6029e10700 1 -- 172.21.15.155:0/3165400573 wait complete. 2024-08-17T02:27:32.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.156+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe514052fe0 con 0x7fe51404f260 2024-08-17T02:27:32.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.156+0000 7fe5117fa700 1 -- 172.21.15.155:0/2127322902 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe518017090 con 0x7fe51404f260 2024-08-17T02:27:32.160 INFO:teuthology.orchestra.run.smithi155.stdout:60129542151 2024-08-17T02:27:32.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-08-17T02:27:32.161 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 msgr2=0x7fe500062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 0x7fe500062d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe514050940 tx=0x7fe50c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 msgr2=0x7fe5140d56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe51800c590 tx=0x7fe518007e00 comp rx=0 tx=0).stop 2024-08-17T02:27:32.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 shutdown_connections 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe5000608e0 0x7fe500062d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5140d8760 0x7fe51404c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe514050540 0x7fe51404e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 --2- 172.21.15.155:0/2127322902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe51404f260 0x7fe5140d56b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 >> 172.21.15.155:0/2127322902 conn(0x7fe514051690 msgr2=0x7fe5140d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 shutdown_connections 2024-08-17T02:27:32.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7fe5225ce700 1 -- 172.21.15.155:0/2127322902 wait complete. 2024-08-17T02:27:32.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11300643a0 con 0x7f113006e140 2024-08-17T02:27:32.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.160+0000 7f11257fa700 1 -- 172.21.15.155:0/571708217 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11200505c0 con 0x7f113006e140 2024-08-17T02:27:32.164 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 msgr2=0x7f1114062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 0x7f1114062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11280076a0 tx=0x7f112800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 msgr2=0x7f1130139d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f112000c790 tx=0x7f1120007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 shutdown_connections 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1114060860 0x7f1114062d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11301556f0 0x7f113013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113006e140 0x7f1130139d30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 --2- 172.21.15.155:0/571708217 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f113006aff0 0x7f113013b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 >> 172.21.15.155:0/571708217 conn(0x7f11300678d0 msgr2=0x7f11300aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1a80acda0 con 0x7fc1a8066e00 2024-08-17T02:27:32.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 shutdown_connections 2024-08-17T02:27:32.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7f113617c700 1 -- 172.21.15.155:0/571708217 wait complete. 2024-08-17T02:27:32.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.164+0000 7fc1967fc700 1 -- 172.21.15.155:0/1878716534 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc198050800 con 0x7fc1a8066e00 2024-08-17T02:27:32.170 INFO:teuthology.orchestra.run.smithi155.stdout:60129542149 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 msgr2=0x7fc188062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 0x7fc188062de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8154980 tx=0x7fc19c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 msgr2=0x7fc1a80a69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b5e0 tx=0x7fc198009120 comp rx=0 tx=0).stop 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 shutdown_connections 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc188060930 0x7fc188062de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc1a80af4d0 0x7fc1a8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1a8067270 0x7fc1a81438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 --2- 172.21.15.155:0/1878716534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1a8066e00 0x7fc1a80a69c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 >> 172.21.15.155:0/1878716534 conn(0x7fc1a806d800 msgr2=0x7fc1a8069820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 shutdown_connections 2024-08-17T02:27:32.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.168+0000 7fc1a759e700 1 -- 172.21.15.155:0/1878716534 wait complete. 2024-08-17T02:27:32.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-08-17T02:27:32.176 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.176+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7270171350 con 0x7f72700b0d90 2024-08-17T02:27:32.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.176+0000 7f726cff9700 1 -- 172.21.15.155:0/4130019157 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7264050a60 con 0x7f72700b0d90 2024-08-17T02:27:32.180 INFO:teuthology.orchestra.run.smithi155.stdout:60129542152 2024-08-17T02:27:32.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 msgr2=0x7f725c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 0x7f725c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7268009880 tx=0x7f7268018000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 msgr2=0x7f72700b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f726400b600 tx=0x7f72640091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 shutdown_connections 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f725c060860 0x7f725c062d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7270156d80 0x7f72701405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72700b0d90 0x7f72700b0410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 --2- 172.21.15.155:0/4130019157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72700ad750 0x7f727016e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 >> 172.21.15.155:0/4130019157 conn(0x7f72700678d0 msgr2=0x7f72700ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-08-17T02:27:32.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 shutdown_connections 2024-08-17T02:27:32.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.180+0000 7f7275fc1700 1 -- 172.21.15.155:0/4130019157 wait complete. 2024-08-17T02:27:32.184 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-08-17T02:27:32.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff600abf00 con 0x7eff600caa20 2024-08-17T02:27:32.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff477fe700 1 -- 172.21.15.155:0/2117821408 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff54052550 con 0x7eff600caa20 2024-08-17T02:27:32.186 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.187 INFO:teuthology.orchestra.run.smithi155.stdout:60129542150 2024-08-17T02:27:32.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 msgr2=0x7eff4c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 0x7eff4c062de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff50009bf0 tx=0x7eff500091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 msgr2=0x7eff60142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 0x7eff60142ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff54013000 tx=0x7eff54017000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 shutdown_connections 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7eff4c060930 0x7eff4c062de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff600cc060 0x7eff600ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff600caa20 0x7eff60142ef0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 --2- 172.21.15.155:0/2117821408 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff600688d0 0x7eff6013b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 >> 172.21.15.155:0/2117821408 conn(0x7eff6006d790 msgr2=0x7eff60063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 shutdown_connections 2024-08-17T02:27:32.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.184+0000 7eff648c3700 1 -- 172.21.15.155:0/2117821408 wait complete. 2024-08-17T02:27:32.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-08-17T02:27:32.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08c80645c0 con 0x7f08c80aab50 2024-08-17T02:27:32.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08af7fe700 1 -- 172.21.15.155:0/4089811849 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08bc019eb0 con 0x7f08c80aab50 2024-08-17T02:27:32.195 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.195 INFO:teuthology.orchestra.run.smithi155.stdout:60129542152 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 msgr2=0x7f08b4062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 0x7f08b4062e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08c815bed0 tx=0x7f08b8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 msgr2=0x7f08c8096ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009290 tx=0x7f08bc017000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 shutdown_connections 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f08b40609b0 0x7f08b4062e60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f08c815a8b0 0x7f08c8097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08c81593b0 0x7f08c80970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 --2- 172.21.15.155:0/4089811849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08c80aab50 0x7f08c8096ba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 >> 172.21.15.155:0/4089811849 conn(0x7f08c8068300 msgr2=0x7f08c806ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 shutdown_connections 2024-08-17T02:27:32.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.192+0000 7f08ad7fa700 1 -- 172.21.15.155:0/4089811849 wait complete. 2024-08-17T02:27:32.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-08-17T02:27:32.198 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-08-17T02:27:32.206 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:32.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:32.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:32.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 Processor -- start 2024-08-17T02:27:32.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- start start 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ea81553e0 0x7f9ea80af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81557b0 0x7f9ea80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 0x7f9ea8068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea8069060 con 0x7f9ea81553e0 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea8155c00 con 0x7f9ea80686a0 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8155e30 con 0x7f9ea81557b0 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ea81553e0 0x7f9ea80af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ea81553e0 0x7f9ea80af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50306/0 (socket says 172.21.15.155:50306) 2024-08-17T02:27:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/2411838105 learned_addr learned my addr 172.21.15.155:0/2411838105 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea67fc700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81557b0 0x7f9ea80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/2411838105 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81557b0 msgr2=0x7f9ea80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea77fe700 1 --2- 172.21.15.155:0/2411838105 >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 0x7f9ea8068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81557b0 0x7f9ea80b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/2411838105 >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 msgr2=0x7f9ea8068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/2411838105 >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 0x7f9ea8068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/2411838105 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8156110 con 0x7f9ea81553e0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea77fe700 1 --2- 172.21.15.155:0/2411838105 >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 0x7f9ea8068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea81553e0 0x7f9ea80af4d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e980099e0 tx=0x7f9e98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247ba17dcf82278 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea5ffb700 1 -- 172.21.15.155:0/2411838105 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800b7e0 con 0x7f9ea81553e0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea5ffb700 1 -- 172.21.15.155:0/2411838105 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800b940 con 0x7f9ea81553e0 2024-08-17T02:27:32.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea5ffb700 1 -- 172.21.15.155:0/2411838105 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800bce0 con 0x7f9ea81553e0 2024-08-17T02:27:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- 172.21.15.155:0/2411838105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea81553e0 msgr2=0x7f9ea80af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea81553e0 0x7f9ea80af4d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e980099e0 tx=0x7f9e98009250 comp rx=0 tx=0).stop 2024-08-17T02:27:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- 172.21.15.155:0/2411838105 shutdown_connections 2024-08-17T02:27:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/2411838105 >> v2:172.21.15.189:3300/0 conn(0x7f9ea80686a0 0x7f9ea8068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81557b0 0x7f9ea80b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/2411838105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea81553e0 0x7f9ea80af4d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- 172.21.15.155:0/2411838105 >> 172.21.15.155:0/2411838105 conn(0x7f9ea806d800 msgr2=0x7f9ea806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- 172.21.15.155:0/2411838105 shutdown_connections 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.352+0000 7f9ea7fff700 1 -- 172.21.15.155:0/2411838105 wait complete. 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 Processor -- start 2024-08-17T02:27:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- start start 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81553e0 0x7f9ea8143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea81557b0 0x7f9ea80a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80a5570 con 0x7f9ea80686a0 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80aaf40 con 0x7f9ea81557b0 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80ab170 con 0x7f9ea81553e0 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50318/0 (socket says 172.21.15.155:50318) 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/914423680 learned_addr learned my addr 172.21.15.155:0/914423680 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea77fe700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea81557b0 0x7f9ea80a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea67fc700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81553e0 0x7f9ea8143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81553e0 msgr2=0x7f9ea8143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81553e0 0x7f9ea8143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea81557b0 msgr2=0x7f9ea80a79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea81557b0 0x7f9ea80a79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 -- 172.21.15.155:0/914423680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980094f0 con 0x7f9ea80686a0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea6ffd700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009290 tx=0x7f9e98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9801a630 con 0x7f9ea80686a0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9801a7b0 con 0x7f9ea80686a0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80ab450 con 0x7f9ea80686a0 2024-08-17T02:27:32.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9801ab70 con 0x7f9ea80686a0 2024-08-17T02:27:32.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.356+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80a5a30 con 0x7f9ea80686a0 2024-08-17T02:27:32.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea806b540 con 0x7f9ea80686a0 2024-08-17T02:27:32.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9e9802d440 con 0x7f9ea80686a0 2024-08-17T02:27:32.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9e9effd700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 0x7f9e88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e9807ead0 con 0x7f9ea80686a0 2024-08-17T02:27:32.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9ea67fc700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 0x7f9e88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.360+0000 7f9ea67fc700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 0x7f9e88062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ea81542e0 tx=0x7f9ea00075e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.364+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9e9804ef20 con 0x7f9ea80686a0 2024-08-17T02:27:32.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:32.462 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:32.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.512+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ea806b540 con 0x7f9e88060860 2024-08-17T02:27:32.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.528+0000 7f9e9effd700 1 -- 172.21.15.155:0/914423680 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264440 (secure 0 0 0) 0x7f9ea806b540 con 0x7f9e88060860 2024-08-17T02:27:32.536 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:32.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 msgr2=0x7f9e88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 0x7f9e88062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ea81542e0 tx=0x7f9ea00075e0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 msgr2=0x7f9ea80aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009290 tx=0x7f9e98017000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 shutdown_connections 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e88060860 0x7f9e88062d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea81557b0 0x7f9ea80a79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9ea81553e0 0x7f9ea8143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 --2- 172.21.15.155:0/914423680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ea80686a0 0x7f9ea80aaa00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 >> 172.21.15.155:0/914423680 conn(0x7f9ea806d800 msgr2=0x7f9ea8148d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 shutdown_connections 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.532+0000 7f9ea7fff700 1 -- 172.21.15.155:0/914423680 wait complete. 2024-08-17T02:27:32.539 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:32.550 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:31.940432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385904,"kb_used_data":2884,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588816,"statfs":{"total":773094113280,"available":770650947584,"internally_reserved":0,"allocated":2953216,"data_stored":1774713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.258677"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714539+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.714539+0000","last_peered":"2024-08-17T02:27:22.714539+0000","last_clean":"2024-08-17T02:27:22.714539+0000","last_became_active":"2024-08-17T02:27:22.709948+0000","last_became_peered":"2024-08-17T02:27:22.709948+0000","last_unstale":"2024-08-17T02:27:22.714539+0000","last_undegraded":"2024-08-17T02:27:22.714539+0000","last_fullsized":"2024-08-17T02:27:22.714539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:31.256882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718042+0000","last_change":"2024-08-17T02:27:22.713233+0000","last_active":"2024-08-17T02:27:22.718042+0000","last_peered":"2024-08-17T02:27:22.718042+0000","last_clean":"2024-08-17T02:27:22.718042+0000","last_became_active":"2024-08-17T02:27:22.712342+0000","last_became_peered":"2024-08-17T02:27:22.712342+0000","last_unstale":"2024-08-17T02:27:22.718042+0000","last_undegraded":"2024-08-17T02:27:22.718042+0000","last_fullsized":"2024-08-17T02:27:22.718042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:47.644721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724729+0000","last_change":"2024-08-17T02:27:22.720583+0000","last_active":"2024-08-17T02:27:22.724729+0000","last_peered":"2024-08-17T02:27:22.724729+0000","last_clean":"2024-08-17T02:27:22.724729+0000","last_became_active":"2024-08-17T02:27:22.720240+0000","last_became_peered":"2024-08-17T02:27:22.720240+0000","last_unstale":"2024-08-17T02:27:22.724729+0000","last_undegraded":"2024-08-17T02:27:22.724729+0000","last_fullsized":"2024-08-17T02:27:22.724729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716830+0000","last_change":"2024-08-17T02:27:22.715254+0000","last_active":"2024-08-17T02:27:22.716830+0000","last_peered":"2024-08-17T02:27:22.716830+0000","last_clean":"2024-08-17T02:27:22.716830+0000","last_became_active":"2024-08-17T02:27:22.714973+0000","last_became_peered":"2024-08-17T02:27:22.714973+0000","last_unstale":"2024-08-17T02:27:22.716830+0000","last_undegraded":"2024-08-17T02:27:22.716830+0000","last_fullsized":"2024-08-17T02:27:22.716830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:28.901609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722056+0000","last_change":"2024-08-17T02:27:22.718174+0000","last_active":"2024-08-17T02:27:22.722056+0000","last_peered":"2024-08-17T02:27:22.722056+0000","last_clean":"2024-08-17T02:27:22.722056+0000","last_became_active":"2024-08-17T02:27:22.715180+0000","last_became_peered":"2024-08-17T02:27:22.715180+0000","last_unstale":"2024-08-17T02:27:22.722056+0000","last_undegraded":"2024-08-17T02:27:22.722056+0000","last_fullsized":"2024-08-17T02:27:22.722056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:33:00.741989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714252+0000","last_change":"2024-08-17T02:27:22.713445+0000","last_active":"2024-08-17T02:27:22.714252+0000","last_peered":"2024-08-17T02:27:22.714252+0000","last_clean":"2024-08-17T02:27:22.714252+0000","last_became_active":"2024-08-17T02:27:22.713175+0000","last_became_peered":"2024-08-17T02:27:22.713175+0000","last_unstale":"2024-08-17T02:27:22.714252+0000","last_undegraded":"2024-08-17T02:27:22.714252+0000","last_fullsized":"2024-08-17T02:27:22.714252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:54.337887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722435+0000","last_change":"2024-08-17T02:27:22.719534+0000","last_active":"2024-08-17T02:27:22.722435+0000","last_peered":"2024-08-17T02:27:22.722435+0000","last_clean":"2024-08-17T02:27:22.722435+0000","last_became_active":"2024-08-17T02:27:22.719271+0000","last_became_peered":"2024-08-17T02:27:22.719271+0000","last_unstale":"2024-08-17T02:27:22.722435+0000","last_undegraded":"2024-08-17T02:27:22.722435+0000","last_fullsized":"2024-08-17T02:27:22.722435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:17.620613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724689+0000","last_change":"2024-08-17T02:27:22.719409+0000","last_active":"2024-08-17T02:27:22.724689+0000","last_peered":"2024-08-17T02:27:22.724689+0000","last_clean":"2024-08-17T02:27:22.724689+0000","last_became_active":"2024-08-17T02:27:22.718966+0000","last_became_peered":"2024-08-17T02:27:22.718966+0000","last_unstale":"2024-08-17T02:27:22.724689+0000","last_undegraded":"2024-08-17T02:27:22.724689+0000","last_fullsized":"2024-08-17T02:27:22.724689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:12.695037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711289+0000","last_change":"2024-08-17T02:27:22.708900+0000","last_active":"2024-08-17T02:27:22.711289+0000","last_peered":"2024-08-17T02:27:22.711289+0000","last_clean":"2024-08-17T02:27:22.711289+0000","last_became_active":"2024-08-17T02:27:22.708639+0000","last_became_peered":"2024-08-17T02:27:22.708639+0000","last_unstale":"2024-08-17T02:27:22.711289+0000","last_undegraded":"2024-08-17T02:27:22.711289+0000","last_fullsized":"2024-08-17T02:27:22.711289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:28.298093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722437+0000","last_change":"2024-08-17T02:27:22.718947+0000","last_active":"2024-08-17T02:27:22.722437+0000","last_peered":"2024-08-17T02:27:22.722437+0000","last_clean":"2024-08-17T02:27:22.722437+0000","last_became_active":"2024-08-17T02:27:22.718468+0000","last_became_peered":"2024-08-17T02:27:22.718468+0000","last_unstale":"2024-08-17T02:27:22.722437+0000","last_undegraded":"2024-08-17T02:27:22.722437+0000","last_fullsized":"2024-08-17T02:27:22.722437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:33.020825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721960+0000","last_change":"2024-08-17T02:27:22.714887+0000","last_active":"2024-08-17T02:27:22.721960+0000","last_peered":"2024-08-17T02:27:22.721960+0000","last_clean":"2024-08-17T02:27:22.721960+0000","last_became_active":"2024-08-17T02:27:22.714523+0000","last_became_peered":"2024-08-17T02:27:22.714523+0000","last_unstale":"2024-08-17T02:27:22.721960+0000","last_undegraded":"2024-08-17T02:27:22.721960+0000","last_fullsized":"2024-08-17T02:27:22.721960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:06:07.993888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714583+0000","last_change":"2024-08-17T02:27:22.705954+0000","last_active":"2024-08-17T02:27:22.714583+0000","last_peered":"2024-08-17T02:27:22.714583+0000","last_clean":"2024-08-17T02:27:22.714583+0000","last_became_active":"2024-08-17T02:27:22.705129+0000","last_became_peered":"2024-08-17T02:27:22.705129+0000","last_unstale":"2024-08-17T02:27:22.714583+0000","last_undegraded":"2024-08-17T02:27:22.714583+0000","last_fullsized":"2024-08-17T02:27:22.714583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:36.875628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713100+0000","last_change":"2024-08-17T02:27:22.711703+0000","last_active":"2024-08-17T02:27:22.713100+0000","last_peered":"2024-08-17T02:27:22.713100+0000","last_clean":"2024-08-17T02:27:22.713100+0000","last_became_active":"2024-08-17T02:27:22.711350+0000","last_became_peered":"2024-08-17T02:27:22.711350+0000","last_unstale":"2024-08-17T02:27:22.713100+0000","last_undegraded":"2024-08-17T02:27:22.713100+0000","last_fullsized":"2024-08-17T02:27:22.713100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:28.003477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707981+0000","last_change":"2024-08-17T02:27:22.702614+0000","last_active":"2024-08-17T02:27:22.707981+0000","last_peered":"2024-08-17T02:27:22.707981+0000","last_clean":"2024-08-17T02:27:22.707981+0000","last_became_active":"2024-08-17T02:27:22.702337+0000","last_became_peered":"2024-08-17T02:27:22.702337+0000","last_unstale":"2024-08-17T02:27:22.707981+0000","last_undegraded":"2024-08-17T02:27:22.707981+0000","last_fullsized":"2024-08-17T02:27:22.707981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:07:22.333869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719804+0000","last_change":"2024-08-17T02:27:22.716233+0000","last_active":"2024-08-17T02:27:22.719804+0000","last_peered":"2024-08-17T02:27:22.719804+0000","last_clean":"2024-08-17T02:27:22.719804+0000","last_became_active":"2024-08-17T02:27:22.715931+0000","last_became_peered":"2024-08-17T02:27:22.715931+0000","last_unstale":"2024-08-17T02:27:22.719804+0000","last_undegraded":"2024-08-17T02:27:22.719804+0000","last_fullsized":"2024-08-17T02:27:22.719804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709764+0000","last_change":"2024-08-17T02:27:22.706621+0000","last_active":"2024-08-17T02:27:22.709764+0000","last_peered":"2024-08-17T02:27:22.709764+0000","last_clean":"2024-08-17T02:27:22.709764+0000","last_became_active":"2024-08-17T02:27:22.705085+0000","last_became_peered":"2024-08-17T02:27:22.705085+0000","last_unstale":"2024-08-17T02:27:22.709764+0000","last_undegraded":"2024-08-17T02:27:22.709764+0000","last_fullsized":"2024-08-17T02:27:22.709764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:05.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711957+0000","last_change":"2024-08-17T02:27:22.707866+0000","last_active":"2024-08-17T02:27:22.711957+0000","last_peered":"2024-08-17T02:27:22.711957+0000","last_clean":"2024-08-17T02:27:22.711957+0000","last_became_active":"2024-08-17T02:27:22.707509+0000","last_became_peered":"2024-08-17T02:27:22.707509+0000","last_unstale":"2024-08-17T02:27:22.711957+0000","last_undegraded":"2024-08-17T02:27:22.711957+0000","last_fullsized":"2024-08-17T02:27:22.711957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:50.650639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.701747+0000","last_change":"2024-08-17T02:27:22.692819+0000","last_active":"2024-08-17T02:27:22.701747+0000","last_peered":"2024-08-17T02:27:22.701747+0000","last_clean":"2024-08-17T02:27:22.701747+0000","last_became_active":"2024-08-17T02:27:22.692445+0000","last_became_peered":"2024-08-17T02:27:22.692445+0000","last_unstale":"2024-08-17T02:27:22.701747+0000","last_undegraded":"2024-08-17T02:27:22.701747+0000","last_fullsized":"2024-08-17T02:27:22.701747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714077+0000","last_change":"2024-08-17T02:27:22.713391+0000","last_active":"2024-08-17T02:27:22.714077+0000","last_peered":"2024-08-17T02:27:22.714077+0000","last_clean":"2024-08-17T02:27:22.714077+0000","last_became_active":"2024-08-17T02:27:22.713117+0000","last_became_peered":"2024-08-17T02:27:22.713117+0000","last_unstale":"2024-08-17T02:27:22.714077+0000","last_undegraded":"2024-08-17T02:27:22.714077+0000","last_fullsized":"2024-08-17T02:27:22.714077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:23.685025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714600+0000","last_change":"2024-08-17T02:27:22.706145+0000","last_active":"2024-08-17T02:27:22.714600+0000","last_peered":"2024-08-17T02:27:22.714600+0000","last_clean":"2024-08-17T02:27:22.714600+0000","last_became_active":"2024-08-17T02:27:22.705632+0000","last_became_peered":"2024-08-17T02:27:22.705632+0000","last_unstale":"2024-08-17T02:27:22.714600+0000","last_undegraded":"2024-08-17T02:27:22.714600+0000","last_fullsized":"2024-08-17T02:27:22.714600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.808731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719617+0000","last_change":"2024-08-17T02:27:22.713685+0000","last_active":"2024-08-17T02:27:22.719617+0000","last_peered":"2024-08-17T02:27:22.719617+0000","last_clean":"2024-08-17T02:27:22.719617+0000","last_became_active":"2024-08-17T02:27:22.713406+0000","last_became_peered":"2024-08-17T02:27:22.713406+0000","last_unstale":"2024-08-17T02:27:22.719617+0000","last_undegraded":"2024-08-17T02:27:22.719617+0000","last_fullsized":"2024-08-17T02:27:22.719617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712608+0000","last_change":"2024-08-17T02:27:22.711278+0000","last_active":"2024-08-17T02:27:22.712608+0000","last_peered":"2024-08-17T02:27:22.712608+0000","last_clean":"2024-08-17T02:27:22.712608+0000","last_became_active":"2024-08-17T02:27:22.710945+0000","last_became_peered":"2024-08-17T02:27:22.710945+0000","last_unstale":"2024-08-17T02:27:22.712608+0000","last_undegraded":"2024-08-17T02:27:22.712608+0000","last_fullsized":"2024-08-17T02:27:22.712608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719769+0000","last_change":"2024-08-17T02:27:22.716220+0000","last_active":"2024-08-17T02:27:22.719769+0000","last_peered":"2024-08-17T02:27:22.719769+0000","last_clean":"2024-08-17T02:27:22.719769+0000","last_became_active":"2024-08-17T02:27:22.714375+0000","last_became_peered":"2024-08-17T02:27:22.714375+0000","last_unstale":"2024-08-17T02:27:22.719769+0000","last_undegraded":"2024-08-17T02:27:22.719769+0000","last_fullsized":"2024-08-17T02:27:22.719769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:51.976961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717283+0000","last_change":"2024-08-17T02:27:22.716173+0000","last_active":"2024-08-17T02:27:22.717283+0000","last_peered":"2024-08-17T02:27:22.717283+0000","last_clean":"2024-08-17T02:27:22.717283+0000","last_became_active":"2024-08-17T02:27:22.715892+0000","last_became_peered":"2024-08-17T02:27:22.715892+0000","last_unstale":"2024-08-17T02:27:22.717283+0000","last_undegraded":"2024-08-17T02:27:22.717283+0000","last_fullsized":"2024-08-17T02:27:22.717283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:02.262851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719843+0000","last_change":"2024-08-17T02:27:22.716737+0000","last_active":"2024-08-17T02:27:22.719843+0000","last_peered":"2024-08-17T02:27:22.719843+0000","last_clean":"2024-08-17T02:27:22.719843+0000","last_became_active":"2024-08-17T02:27:22.715984+0000","last_became_peered":"2024-08-17T02:27:22.715984+0000","last_unstale":"2024-08-17T02:27:22.719843+0000","last_undegraded":"2024-08-17T02:27:22.719843+0000","last_fullsized":"2024-08-17T02:27:22.719843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:02.516802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712777+0000","last_change":"2024-08-17T02:27:22.708044+0000","last_active":"2024-08-17T02:27:22.712777+0000","last_peered":"2024-08-17T02:27:22.712777+0000","last_clean":"2024-08-17T02:27:22.712777+0000","last_became_active":"2024-08-17T02:27:22.707573+0000","last_became_peered":"2024-08-17T02:27:22.707573+0000","last_unstale":"2024-08-17T02:27:22.712777+0000","last_undegraded":"2024-08-17T02:27:22.712777+0000","last_fullsized":"2024-08-17T02:27:22.712777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:48.395371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707359+0000","last_change":"2024-08-17T02:27:22.703317+0000","last_active":"2024-08-17T02:27:22.707359+0000","last_peered":"2024-08-17T02:27:22.707359+0000","last_clean":"2024-08-17T02:27:22.707359+0000","last_became_active":"2024-08-17T02:27:22.703015+0000","last_became_peered":"2024-08-17T02:27:22.703015+0000","last_unstale":"2024-08-17T02:27:22.707359+0000","last_undegraded":"2024-08-17T02:27:22.707359+0000","last_fullsized":"2024-08-17T02:27:22.707359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719147+0000","last_change":"2024-08-17T02:27:22.715163+0000","last_active":"2024-08-17T02:27:22.719147+0000","last_peered":"2024-08-17T02:27:22.719147+0000","last_clean":"2024-08-17T02:27:22.719147+0000","last_became_active":"2024-08-17T02:27:22.714822+0000","last_became_peered":"2024-08-17T02:27:22.714822+0000","last_unstale":"2024-08-17T02:27:22.719147+0000","last_undegraded":"2024-08-17T02:27:22.719147+0000","last_fullsized":"2024-08-17T02:27:22.719147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:16.375853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713814+0000","last_change":"2024-08-17T02:27:22.708377+0000","last_active":"2024-08-17T02:27:22.713814+0000","last_peered":"2024-08-17T02:27:22.713814+0000","last_clean":"2024-08-17T02:27:22.713814+0000","last_became_active":"2024-08-17T02:27:22.708110+0000","last_became_peered":"2024-08-17T02:27:22.708110+0000","last_unstale":"2024-08-17T02:27:22.713814+0000","last_undegraded":"2024-08-17T02:27:22.713814+0000","last_fullsized":"2024-08-17T02:27:22.713814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:00.145322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717346+0000","last_change":"2024-08-17T02:27:22.716325+0000","last_active":"2024-08-17T02:27:22.717346+0000","last_peered":"2024-08-17T02:27:22.717346+0000","last_clean":"2024-08-17T02:27:22.717346+0000","last_became_active":"2024-08-17T02:27:22.715973+0000","last_became_peered":"2024-08-17T02:27:22.715973+0000","last_unstale":"2024-08-17T02:27:22.717346+0000","last_undegraded":"2024-08-17T02:27:22.717346+0000","last_fullsized":"2024-08-17T02:27:22.717346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:10.581368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706793+0000","last_change":"2024-08-17T02:27:22.702498+0000","last_active":"2024-08-17T02:27:22.706793+0000","last_peered":"2024-08-17T02:27:22.706793+0000","last_clean":"2024-08-17T02:27:22.706793+0000","last_became_active":"2024-08-17T02:27:22.702167+0000","last_became_peered":"2024-08-17T02:27:22.702167+0000","last_unstale":"2024-08-17T02:27:22.706793+0000","last_undegraded":"2024-08-17T02:27:22.706793+0000","last_fullsized":"2024-08-17T02:27:22.706793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:04.036357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709416+0000","last_change":"2024-08-17T02:27:22.704139+0000","last_active":"2024-08-17T02:27:22.709416+0000","last_peered":"2024-08-17T02:27:22.709416+0000","last_clean":"2024-08-17T02:27:22.709416+0000","last_became_active":"2024-08-17T02:27:22.703169+0000","last_became_peered":"2024-08-17T02:27:22.703169+0000","last_unstale":"2024-08-17T02:27:22.709416+0000","last_undegraded":"2024-08-17T02:27:22.709416+0000","last_fullsized":"2024-08-17T02:27:22.709416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716771+0000","last_change":"2024-08-17T02:27:22.715481+0000","last_active":"2024-08-17T02:27:22.716771+0000","last_peered":"2024-08-17T02:27:22.716771+0000","last_clean":"2024-08-17T02:27:22.716771+0000","last_became_active":"2024-08-17T02:27:22.715124+0000","last_became_peered":"2024-08-17T02:27:22.715124+0000","last_unstale":"2024-08-17T02:27:22.716771+0000","last_undegraded":"2024-08-17T02:27:22.716771+0000","last_fullsized":"2024-08-17T02:27:22.716771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715671+0000","last_change":"2024-08-17T02:27:21.681341+0000","last_active":"2024-08-17T02:27:22.715671+0000","last_peered":"2024-08-17T02:27:22.715671+0000","last_clean":"2024-08-17T02:27:22.715671+0000","last_became_active":"2024-08-17T02:27:21.681038+0000","last_became_peered":"2024-08-17T02:27:21.681038+0000","last_unstale":"2024-08-17T02:27:22.715671+0000","last_undegraded":"2024-08-17T02:27:22.715671+0000","last_fullsized":"2024-08-17T02:27:22.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.723868+0000","last_change":"2024-08-17T02:27:22.722197+0000","last_active":"2024-08-17T02:27:22.723868+0000","last_peered":"2024-08-17T02:27:22.723868+0000","last_clean":"2024-08-17T02:27:22.723868+0000","last_became_active":"2024-08-17T02:27:22.721882+0000","last_became_peered":"2024-08-17T02:27:22.721882+0000","last_unstale":"2024-08-17T02:27:22.723868+0000","last_undegraded":"2024-08-17T02:27:22.723868+0000","last_fullsized":"2024-08-17T02:27:22.723868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712031+0000","last_change":"2024-08-17T02:27:21.681865+0000","last_active":"2024-08-17T02:27:22.712031+0000","last_peered":"2024-08-17T02:27:22.712031+0000","last_clean":"2024-08-17T02:27:22.712031+0000","last_became_active":"2024-08-17T02:27:21.681071+0000","last_became_peered":"2024-08-17T02:27:21.681071+0000","last_unstale":"2024-08-17T02:27:22.712031+0000","last_undegraded":"2024-08-17T02:27:22.712031+0000","last_fullsized":"2024-08-17T02:27:22.712031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:47.386952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694890+0000","last_change":"2024-08-17T02:27:21.681027+0000","last_active":"2024-08-17T02:27:22.694890+0000","last_peered":"2024-08-17T02:27:22.694890+0000","last_clean":"2024-08-17T02:27:22.694890+0000","last_became_active":"2024-08-17T02:27:21.680738+0000","last_became_peered":"2024-08-17T02:27:21.680738+0000","last_unstale":"2024-08-17T02:27:22.694890+0000","last_undegraded":"2024-08-17T02:27:22.694890+0000","last_fullsized":"2024-08-17T02:27:22.694890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716007+0000","last_change":"2024-08-17T02:27:22.711080+0000","last_active":"2024-08-17T02:27:22.716007+0000","last_peered":"2024-08-17T02:27:22.716007+0000","last_clean":"2024-08-17T02:27:22.716007+0000","last_became_active":"2024-08-17T02:27:22.710758+0000","last_became_peered":"2024-08-17T02:27:22.710758+0000","last_unstale":"2024-08-17T02:27:22.716007+0000","last_undegraded":"2024-08-17T02:27:22.716007+0000","last_fullsized":"2024-08-17T02:27:22.716007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:23.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688653+0000","last_change":"2024-08-17T02:27:21.683107+0000","last_active":"2024-08-17T02:27:22.688653+0000","last_peered":"2024-08-17T02:27:22.688653+0000","last_clean":"2024-08-17T02:27:22.688653+0000","last_became_active":"2024-08-17T02:27:21.682425+0000","last_became_peered":"2024-08-17T02:27:21.682425+0000","last_unstale":"2024-08-17T02:27:22.688653+0000","last_undegraded":"2024-08-17T02:27:22.688653+0000","last_fullsized":"2024-08-17T02:27:22.688653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:44.884474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718332+0000","last_change":"2024-08-17T02:27:22.707768+0000","last_active":"2024-08-17T02:27:22.718332+0000","last_peered":"2024-08-17T02:27:22.718332+0000","last_clean":"2024-08-17T02:27:22.718332+0000","last_became_active":"2024-08-17T02:27:22.704583+0000","last_became_peered":"2024-08-17T02:27:22.704583+0000","last_unstale":"2024-08-17T02:27:22.718332+0000","last_undegraded":"2024-08-17T02:27:22.718332+0000","last_fullsized":"2024-08-17T02:27:22.718332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.697955+0000","last_change":"2024-08-17T02:27:21.675353+0000","last_active":"2024-08-17T02:27:22.697955+0000","last_peered":"2024-08-17T02:27:22.697955+0000","last_clean":"2024-08-17T02:27:22.697955+0000","last_became_active":"2024-08-17T02:27:21.675012+0000","last_became_peered":"2024-08-17T02:27:21.675012+0000","last_unstale":"2024-08-17T02:27:22.697955+0000","last_undegraded":"2024-08-17T02:27:22.697955+0000","last_fullsized":"2024-08-17T02:27:22.697955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712879+0000","last_change":"2024-08-17T02:27:22.709387+0000","last_active":"2024-08-17T02:27:22.712879+0000","last_peered":"2024-08-17T02:27:22.712879+0000","last_clean":"2024-08-17T02:27:22.712879+0000","last_became_active":"2024-08-17T02:27:22.708326+0000","last_became_peered":"2024-08-17T02:27:22.708326+0000","last_unstale":"2024-08-17T02:27:22.712879+0000","last_undegraded":"2024-08-17T02:27:22.712879+0000","last_fullsized":"2024-08-17T02:27:22.712879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:18.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702030+0000","last_change":"2024-08-17T02:27:21.683255+0000","last_active":"2024-08-17T02:27:22.702030+0000","last_peered":"2024-08-17T02:27:22.702030+0000","last_clean":"2024-08-17T02:27:22.702030+0000","last_became_active":"2024-08-17T02:27:21.682833+0000","last_became_peered":"2024-08-17T02:27:21.682833+0000","last_unstale":"2024-08-17T02:27:22.702030+0000","last_undegraded":"2024-08-17T02:27:22.702030+0000","last_fullsized":"2024-08-17T02:27:22.702030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:32.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713451+0000","last_change":"2024-08-17T02:27:22.707536+0000","last_active":"2024-08-17T02:27:22.713451+0000","last_peered":"2024-08-17T02:27:22.713451+0000","last_clean":"2024-08-17T02:27:22.713451+0000","last_became_active":"2024-08-17T02:27:22.705906+0000","last_became_peered":"2024-08-17T02:27:22.705906+0000","last_unstale":"2024-08-17T02:27:22.713451+0000","last_undegraded":"2024-08-17T02:27:22.713451+0000","last_fullsized":"2024-08-17T02:27:22.713451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.705771+0000","last_change":"2024-08-17T02:27:21.679646+0000","last_active":"2024-08-17T02:27:22.705771+0000","last_peered":"2024-08-17T02:27:22.705771+0000","last_clean":"2024-08-17T02:27:22.705771+0000","last_became_active":"2024-08-17T02:27:21.679295+0000","last_became_peered":"2024-08-17T02:27:21.679295+0000","last_unstale":"2024-08-17T02:27:22.705771+0000","last_undegraded":"2024-08-17T02:27:22.705771+0000","last_fullsized":"2024-08-17T02:27:22.705771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706909+0000","last_change":"2024-08-17T02:27:22.703760+0000","last_active":"2024-08-17T02:27:22.706909+0000","last_peered":"2024-08-17T02:27:22.706909+0000","last_clean":"2024-08-17T02:27:22.706909+0000","last_became_active":"2024-08-17T02:27:22.703453+0000","last_became_peered":"2024-08-17T02:27:22.703453+0000","last_unstale":"2024-08-17T02:27:22.706909+0000","last_undegraded":"2024-08-17T02:27:22.706909+0000","last_fullsized":"2024-08-17T02:27:22.706909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720580+0000","last_change":"2024-08-17T02:27:21.679961+0000","last_active":"2024-08-17T02:27:22.720580+0000","last_peered":"2024-08-17T02:27:22.720580+0000","last_clean":"2024-08-17T02:27:22.720580+0000","last_became_active":"2024-08-17T02:27:21.679617+0000","last_became_peered":"2024-08-17T02:27:21.679617+0000","last_unstale":"2024-08-17T02:27:22.720580+0000","last_undegraded":"2024-08-17T02:27:22.720580+0000","last_fullsized":"2024-08-17T02:27:22.720580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714770+0000","last_change":"2024-08-17T02:27:22.706055+0000","last_active":"2024-08-17T02:27:22.714770+0000","last_peered":"2024-08-17T02:27:22.714770+0000","last_clean":"2024-08-17T02:27:22.714770+0000","last_became_active":"2024-08-17T02:27:22.705762+0000","last_became_peered":"2024-08-17T02:27:22.705762+0000","last_unstale":"2024-08-17T02:27:22.714770+0000","last_undegraded":"2024-08-17T02:27:22.714770+0000","last_fullsized":"2024-08-17T02:27:22.714770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:10:34.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702078+0000","last_change":"2024-08-17T02:27:21.682999+0000","last_active":"2024-08-17T02:27:22.702078+0000","last_peered":"2024-08-17T02:27:22.702078+0000","last_clean":"2024-08-17T02:27:22.702078+0000","last_became_active":"2024-08-17T02:27:21.682681+0000","last_became_peered":"2024-08-17T02:27:21.682681+0000","last_unstale":"2024-08-17T02:27:22.702078+0000","last_undegraded":"2024-08-17T02:27:22.702078+0000","last_fullsized":"2024-08-17T02:27:22.702078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711176+0000","last_change":"2024-08-17T02:27:22.706043+0000","last_active":"2024-08-17T02:27:22.711176+0000","last_peered":"2024-08-17T02:27:22.711176+0000","last_clean":"2024-08-17T02:27:22.711176+0000","last_became_active":"2024-08-17T02:27:22.705777+0000","last_became_peered":"2024-08-17T02:27:22.705777+0000","last_unstale":"2024-08-17T02:27:22.711176+0000","last_undegraded":"2024-08-17T02:27:22.711176+0000","last_fullsized":"2024-08-17T02:27:22.711176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688867+0000","last_change":"2024-08-17T02:27:21.677481+0000","last_active":"2024-08-17T02:27:22.688867+0000","last_peered":"2024-08-17T02:27:22.688867+0000","last_clean":"2024-08-17T02:27:22.688867+0000","last_became_active":"2024-08-17T02:27:21.676761+0000","last_became_peered":"2024-08-17T02:27:21.676761+0000","last_unstale":"2024-08-17T02:27:22.688867+0000","last_undegraded":"2024-08-17T02:27:22.688867+0000","last_fullsized":"2024-08-17T02:27:22.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:08.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711894+0000","last_change":"2024-08-17T02:27:22.711222+0000","last_active":"2024-08-17T02:27:22.711894+0000","last_peered":"2024-08-17T02:27:22.711894+0000","last_clean":"2024-08-17T02:27:22.711894+0000","last_became_active":"2024-08-17T02:27:22.710967+0000","last_became_peered":"2024-08-17T02:27:22.710967+0000","last_unstale":"2024-08-17T02:27:22.711894+0000","last_undegraded":"2024-08-17T02:27:22.711894+0000","last_fullsized":"2024-08-17T02:27:22.711894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:43.683949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695550+0000","last_change":"2024-08-17T02:27:21.687679+0000","last_active":"2024-08-17T02:27:22.695550+0000","last_peered":"2024-08-17T02:27:22.695550+0000","last_clean":"2024-08-17T02:27:22.695550+0000","last_became_active":"2024-08-17T02:27:21.687401+0000","last_became_peered":"2024-08-17T02:27:21.687401+0000","last_unstale":"2024-08-17T02:27:22.695550+0000","last_undegraded":"2024-08-17T02:27:22.695550+0000","last_fullsized":"2024-08-17T02:27:22.695550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:38.795028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720949+0000","last_change":"2024-08-17T02:27:22.719603+0000","last_active":"2024-08-17T02:27:22.720949+0000","last_peered":"2024-08-17T02:27:22.720949+0000","last_clean":"2024-08-17T02:27:22.720949+0000","last_became_active":"2024-08-17T02:27:22.719280+0000","last_became_peered":"2024-08-17T02:27:22.719280+0000","last_unstale":"2024-08-17T02:27:22.720949+0000","last_undegraded":"2024-08-17T02:27:22.720949+0000","last_fullsized":"2024-08-17T02:27:22.720949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719573+0000","last_change":"2024-08-17T02:27:21.679122+0000","last_active":"2024-08-17T02:27:22.719573+0000","last_peered":"2024-08-17T02:27:22.719573+0000","last_clean":"2024-08-17T02:27:22.719573+0000","last_became_active":"2024-08-17T02:27:21.678813+0000","last_became_peered":"2024-08-17T02:27:21.678813+0000","last_unstale":"2024-08-17T02:27:22.719573+0000","last_undegraded":"2024-08-17T02:27:22.719573+0000","last_fullsized":"2024-08-17T02:27:22.719573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706847+0000","last_change":"2024-08-17T02:27:22.703352+0000","last_active":"2024-08-17T02:27:22.706847+0000","last_peered":"2024-08-17T02:27:22.706847+0000","last_clean":"2024-08-17T02:27:22.706847+0000","last_became_active":"2024-08-17T02:27:22.703066+0000","last_became_peered":"2024-08-17T02:27:22.703066+0000","last_unstale":"2024-08-17T02:27:22.706847+0000","last_undegraded":"2024-08-17T02:27:22.706847+0000","last_fullsized":"2024-08-17T02:27:22.706847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718462+0000","last_change":"2024-08-17T02:27:21.684496+0000","last_active":"2024-08-17T02:27:22.718462+0000","last_peered":"2024-08-17T02:27:22.718462+0000","last_clean":"2024-08-17T02:27:22.718462+0000","last_became_active":"2024-08-17T02:27:21.684210+0000","last_became_peered":"2024-08-17T02:27:21.684210+0000","last_unstale":"2024-08-17T02:27:22.718462+0000","last_undegraded":"2024-08-17T02:27:22.718462+0000","last_fullsized":"2024-08-17T02:27:22.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:46.288307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712912+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.712912+0000","last_peered":"2024-08-17T02:27:22.712912+0000","last_clean":"2024-08-17T02:27:22.712912+0000","last_became_active":"2024-08-17T02:27:22.709505+0000","last_became_peered":"2024-08-17T02:27:22.709505+0000","last_unstale":"2024-08-17T02:27:22.712912+0000","last_undegraded":"2024-08-17T02:27:22.712912+0000","last_fullsized":"2024-08-17T02:27:22.712912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:09.433325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714732+0000","last_change":"2024-08-17T02:27:21.676534+0000","last_active":"2024-08-17T02:27:22.714732+0000","last_peered":"2024-08-17T02:27:22.714732+0000","last_clean":"2024-08-17T02:27:22.714732+0000","last_became_active":"2024-08-17T02:27:21.676222+0000","last_became_peered":"2024-08-17T02:27:21.676222+0000","last_unstale":"2024-08-17T02:27:22.714732+0000","last_undegraded":"2024-08-17T02:27:22.714732+0000","last_fullsized":"2024-08-17T02:27:22.714732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714565+0000","last_change":"2024-08-17T02:27:22.710824+0000","last_active":"2024-08-17T02:27:22.714565+0000","last_peered":"2024-08-17T02:27:22.714565+0000","last_clean":"2024-08-17T02:27:22.714565+0000","last_became_active":"2024-08-17T02:27:22.710510+0000","last_became_peered":"2024-08-17T02:27:22.710510+0000","last_unstale":"2024-08-17T02:27:22.714565+0000","last_undegraded":"2024-08-17T02:27:22.714565+0000","last_fullsized":"2024-08-17T02:27:22.714565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:04.586592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717136+0000","last_change":"2024-08-17T02:27:21.682443+0000","last_active":"2024-08-17T02:27:22.717136+0000","last_peered":"2024-08-17T02:27:22.717136+0000","last_clean":"2024-08-17T02:27:22.717136+0000","last_became_active":"2024-08-17T02:27:21.682090+0000","last_became_peered":"2024-08-17T02:27:21.682090+0000","last_unstale":"2024-08-17T02:27:22.717136+0000","last_undegraded":"2024-08-17T02:27:22.717136+0000","last_fullsized":"2024-08-17T02:27:22.717136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721878+0000","last_change":"2024-08-17T02:27:22.714014+0000","last_active":"2024-08-17T02:27:22.721878+0000","last_peered":"2024-08-17T02:27:22.721878+0000","last_clean":"2024-08-17T02:27:22.721878+0000","last_became_active":"2024-08-17T02:27:22.710360+0000","last_became_peered":"2024-08-17T02:27:22.710360+0000","last_unstale":"2024-08-17T02:27:22.721878+0000","last_undegraded":"2024-08-17T02:27:22.721878+0000","last_fullsized":"2024-08-17T02:27:22.721878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:13.548023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695461+0000","last_change":"2024-08-17T02:27:21.684019+0000","last_active":"2024-08-17T02:27:22.695461+0000","last_peered":"2024-08-17T02:27:22.695461+0000","last_clean":"2024-08-17T02:27:22.695461+0000","last_became_active":"2024-08-17T02:27:21.683698+0000","last_became_peered":"2024-08-17T02:27:21.683698+0000","last_unstale":"2024-08-17T02:27:22.695461+0000","last_undegraded":"2024-08-17T02:27:22.695461+0000","last_fullsized":"2024-08-17T02:27:22.695461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707656+0000","last_change":"2024-08-17T02:27:22.704813+0000","last_active":"2024-08-17T02:27:22.707656+0000","last_peered":"2024-08-17T02:27:22.707656+0000","last_clean":"2024-08-17T02:27:22.707656+0000","last_became_active":"2024-08-17T02:27:22.703693+0000","last_became_peered":"2024-08-17T02:27:22.703693+0000","last_unstale":"2024-08-17T02:27:22.707656+0000","last_undegraded":"2024-08-17T02:27:22.707656+0000","last_fullsized":"2024-08-17T02:27:22.707656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:43.268210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.698112+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:22.698112+0000","last_peered":"2024-08-17T02:27:22.698112+0000","last_clean":"2024-08-17T02:27:22.698112+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:22.698112+0000","last_undegraded":"2024-08-17T02:27:22.698112+0000","last_fullsized":"2024-08-17T02:27:22.698112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688750+0000","last_change":"2024-08-17T02:27:21.677758+0000","last_active":"2024-08-17T02:27:22.688750+0000","last_peered":"2024-08-17T02:27:22.688750+0000","last_clean":"2024-08-17T02:27:22.688750+0000","last_became_active":"2024-08-17T02:27:21.677435+0000","last_became_peered":"2024-08-17T02:27:21.677435+0000","last_unstale":"2024-08-17T02:27:22.688750+0000","last_undegraded":"2024-08-17T02:27:22.688750+0000","last_fullsized":"2024-08-17T02:27:22.688750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:17.811669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718263+0000","last_change":"2024-08-17T02:27:22.707547+0000","last_active":"2024-08-17T02:27:22.718263+0000","last_peered":"2024-08-17T02:27:22.718263+0000","last_clean":"2024-08-17T02:27:22.718263+0000","last_became_active":"2024-08-17T02:27:22.707067+0000","last_became_peered":"2024-08-17T02:27:22.707067+0000","last_unstale":"2024-08-17T02:27:22.718263+0000","last_undegraded":"2024-08-17T02:27:22.718263+0000","last_fullsized":"2024-08-17T02:27:22.718263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:54.622575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688823+0000","last_change":"2024-08-17T02:27:21.679784+0000","last_active":"2024-08-17T02:27:22.688823+0000","last_peered":"2024-08-17T02:27:22.688823+0000","last_clean":"2024-08-17T02:27:22.688823+0000","last_became_active":"2024-08-17T02:27:21.679452+0000","last_became_peered":"2024-08-17T02:27:21.679452+0000","last_unstale":"2024-08-17T02:27:22.688823+0000","last_undegraded":"2024-08-17T02:27:22.688823+0000","last_fullsized":"2024-08-17T02:27:22.688823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:59.136904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707149+0000","last_change":"2024-08-17T02:27:22.703264+0000","last_active":"2024-08-17T02:27:22.707149+0000","last_peered":"2024-08-17T02:27:22.707149+0000","last_clean":"2024-08-17T02:27:22.707149+0000","last_became_active":"2024-08-17T02:27:22.702948+0000","last_became_peered":"2024-08-17T02:27:22.702948+0000","last_unstale":"2024-08-17T02:27:22.707149+0000","last_undegraded":"2024-08-17T02:27:22.707149+0000","last_fullsized":"2024-08-17T02:27:22.707149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688627+0000","last_change":"2024-08-17T02:27:21.679287+0000","last_active":"2024-08-17T02:27:22.688627+0000","last_peered":"2024-08-17T02:27:22.688627+0000","last_clean":"2024-08-17T02:27:22.688627+0000","last_became_active":"2024-08-17T02:27:21.678975+0000","last_became_peered":"2024-08-17T02:27:21.678975+0000","last_unstale":"2024-08-17T02:27:22.688627+0000","last_undegraded":"2024-08-17T02:27:22.688627+0000","last_fullsized":"2024-08-17T02:27:22.688627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717995+0000","last_change":"2024-08-17T02:27:22.713099+0000","last_active":"2024-08-17T02:27:22.717995+0000","last_peered":"2024-08-17T02:27:22.717995+0000","last_clean":"2024-08-17T02:27:22.717995+0000","last_became_active":"2024-08-17T02:27:22.712804+0000","last_became_peered":"2024-08-17T02:27:22.712804+0000","last_unstale":"2024-08-17T02:27:22.717995+0000","last_undegraded":"2024-08-17T02:27:22.717995+0000","last_fullsized":"2024-08-17T02:27:22.717995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689010+0000","last_change":"2024-08-17T02:27:21.682058+0000","last_active":"2024-08-17T02:27:22.689010+0000","last_peered":"2024-08-17T02:27:22.689010+0000","last_clean":"2024-08-17T02:27:22.689010+0000","last_became_active":"2024-08-17T02:27:21.681408+0000","last_became_peered":"2024-08-17T02:27:21.681408+0000","last_unstale":"2024-08-17T02:27:22.689010+0000","last_undegraded":"2024-08-17T02:27:22.689010+0000","last_fullsized":"2024-08-17T02:27:22.689010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:58.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722390+0000","last_change":"2024-08-17T02:27:22.718925+0000","last_active":"2024-08-17T02:27:22.722390+0000","last_peered":"2024-08-17T02:27:22.722390+0000","last_clean":"2024-08-17T02:27:22.722390+0000","last_became_active":"2024-08-17T02:27:22.718611+0000","last_became_peered":"2024-08-17T02:27:22.718611+0000","last_unstale":"2024-08-17T02:27:22.722390+0000","last_undegraded":"2024-08-17T02:27:22.722390+0000","last_fullsized":"2024-08-17T02:27:22.722390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:38.536122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710005+0000","last_change":"2024-08-17T02:27:21.680603+0000","last_active":"2024-08-17T02:27:22.710005+0000","last_peered":"2024-08-17T02:27:22.710005+0000","last_clean":"2024-08-17T02:27:22.710005+0000","last_became_active":"2024-08-17T02:27:21.680266+0000","last_became_peered":"2024-08-17T02:27:21.680266+0000","last_unstale":"2024-08-17T02:27:22.710005+0000","last_undegraded":"2024-08-17T02:27:22.710005+0000","last_fullsized":"2024-08-17T02:27:22.710005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706471+0000","last_change":"2024-08-17T02:27:22.701991+0000","last_active":"2024-08-17T02:27:22.706471+0000","last_peered":"2024-08-17T02:27:22.706471+0000","last_clean":"2024-08-17T02:27:22.706471+0000","last_became_active":"2024-08-17T02:27:22.701697+0000","last_became_peered":"2024-08-17T02:27:22.701697+0000","last_unstale":"2024-08-17T02:27:22.706471+0000","last_undegraded":"2024-08-17T02:27:22.706471+0000","last_fullsized":"2024-08-17T02:27:22.706471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689440+0000","last_change":"2024-08-17T02:27:21.680806+0000","last_active":"2024-08-17T02:27:22.689440+0000","last_peered":"2024-08-17T02:27:22.689440+0000","last_clean":"2024-08-17T02:27:22.689440+0000","last_became_active":"2024-08-17T02:27:21.680436+0000","last_became_peered":"2024-08-17T02:27:21.680436+0000","last_unstale":"2024-08-17T02:27:22.689440+0000","last_undegraded":"2024-08-17T02:27:22.689440+0000","last_fullsized":"2024-08-17T02:27:22.689440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:54.813140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712702+0000","last_change":"2024-08-17T02:27:22.708669+0000","last_active":"2024-08-17T02:27:22.712702+0000","last_peered":"2024-08-17T02:27:22.712702+0000","last_clean":"2024-08-17T02:27:22.712702+0000","last_became_active":"2024-08-17T02:27:22.708410+0000","last_became_peered":"2024-08-17T02:27:22.708410+0000","last_unstale":"2024-08-17T02:27:22.712702+0000","last_undegraded":"2024-08-17T02:27:22.712702+0000","last_fullsized":"2024-08-17T02:27:22.712702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:41.242530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:23.687372+0000","last_change":"2024-08-17T02:27:21.687483+0000","last_active":"2024-08-17T02:27:23.687372+0000","last_peered":"2024-08-17T02:27:23.687372+0000","last_clean":"2024-08-17T02:27:23.687372+0000","last_became_active":"2024-08-17T02:27:21.687178+0000","last_became_peered":"2024-08-17T02:27:21.687178+0000","last_unstale":"2024-08-17T02:27:23.687372+0000","last_undegraded":"2024-08-17T02:27:23.687372+0000","last_fullsized":"2024-08-17T02:27:23.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719763+0000","last_change":"2024-08-17T02:27:22.712440+0000","last_active":"2024-08-17T02:27:22.719763+0000","last_peered":"2024-08-17T02:27:22.719763+0000","last_clean":"2024-08-17T02:27:22.719763+0000","last_became_active":"2024-08-17T02:27:22.709883+0000","last_became_peered":"2024-08-17T02:27:22.709883+0000","last_unstale":"2024-08-17T02:27:22.719763+0000","last_undegraded":"2024-08-17T02:27:22.719763+0000","last_fullsized":"2024-08-17T02:27:22.719763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715159+0000","last_change":"2024-08-17T02:27:21.684633+0000","last_active":"2024-08-17T02:27:22.715159+0000","last_peered":"2024-08-17T02:27:22.715159+0000","last_clean":"2024-08-17T02:27:22.715159+0000","last_became_active":"2024-08-17T02:27:21.684363+0000","last_became_peered":"2024-08-17T02:27:21.684363+0000","last_unstale":"2024-08-17T02:27:22.715159+0000","last_undegraded":"2024-08-17T02:27:22.715159+0000","last_fullsized":"2024-08-17T02:27:22.715159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:28.025035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719493+0000","last_change":"2024-08-17T02:27:22.712731+0000","last_active":"2024-08-17T02:27:22.719493+0000","last_peered":"2024-08-17T02:27:22.719493+0000","last_clean":"2024-08-17T02:27:22.719493+0000","last_became_active":"2024-08-17T02:27:22.712439+0000","last_became_peered":"2024-08-17T02:27:22.712439+0000","last_unstale":"2024-08-17T02:27:22.719493+0000","last_undegraded":"2024-08-17T02:27:22.719493+0000","last_fullsized":"2024-08-17T02:27:22.719493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:11.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694453+0000","last_change":"2024-08-17T02:27:21.683181+0000","last_active":"2024-08-17T02:27:22.694453+0000","last_peered":"2024-08-17T02:27:22.694453+0000","last_clean":"2024-08-17T02:27:22.694453+0000","last_became_active":"2024-08-17T02:27:21.682819+0000","last_became_peered":"2024-08-17T02:27:21.682819+0000","last_unstale":"2024-08-17T02:27:22.694453+0000","last_undegraded":"2024-08-17T02:27:22.694453+0000","last_fullsized":"2024-08-17T02:27:22.694453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:38.047941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710652+0000","last_change":"2024-08-17T02:27:22.708585+0000","last_active":"2024-08-17T02:27:22.710652+0000","last_peered":"2024-08-17T02:27:22.710652+0000","last_clean":"2024-08-17T02:27:22.710652+0000","last_became_active":"2024-08-17T02:27:22.708311+0000","last_became_peered":"2024-08-17T02:27:22.708311+0000","last_unstale":"2024-08-17T02:27:22.710652+0000","last_undegraded":"2024-08-17T02:27:22.710652+0000","last_fullsized":"2024-08-17T02:27:22.710652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:09.513436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.700112+0000","last_change":"2024-08-17T02:27:21.680475+0000","last_active":"2024-08-17T02:27:22.700112+0000","last_peered":"2024-08-17T02:27:22.700112+0000","last_clean":"2024-08-17T02:27:22.700112+0000","last_became_active":"2024-08-17T02:27:21.680155+0000","last_became_peered":"2024-08-17T02:27:21.680155+0000","last_unstale":"2024-08-17T02:27:22.700112+0000","last_undegraded":"2024-08-17T02:27:22.700112+0000","last_fullsized":"2024-08-17T02:27:22.700112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719660+0000","last_change":"2024-08-17T02:27:22.714582+0000","last_active":"2024-08-17T02:27:22.719660+0000","last_peered":"2024-08-17T02:27:22.719660+0000","last_clean":"2024-08-17T02:27:22.719660+0000","last_became_active":"2024-08-17T02:27:22.713772+0000","last_became_peered":"2024-08-17T02:27:22.713772+0000","last_unstale":"2024-08-17T02:27:22.719660+0000","last_undegraded":"2024-08-17T02:27:22.719660+0000","last_fullsized":"2024-08-17T02:27:22.719660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:45.892893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695233+0000","last_change":"2024-08-17T02:27:21.676299+0000","last_active":"2024-08-17T02:27:22.695233+0000","last_peered":"2024-08-17T02:27:22.695233+0000","last_clean":"2024-08-17T02:27:22.695233+0000","last_became_active":"2024-08-17T02:27:21.676010+0000","last_became_peered":"2024-08-17T02:27:21.676010+0000","last_unstale":"2024-08-17T02:27:22.695233+0000","last_undegraded":"2024-08-17T02:27:22.695233+0000","last_fullsized":"2024-08-17T02:27:22.695233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706737+0000","last_change":"2024-08-17T02:27:22.701911+0000","last_active":"2024-08-17T02:27:22.706737+0000","last_peered":"2024-08-17T02:27:22.706737+0000","last_clean":"2024-08-17T02:27:22.706737+0000","last_became_active":"2024-08-17T02:27:22.701476+0000","last_became_peered":"2024-08-17T02:27:22.701476+0000","last_unstale":"2024-08-17T02:27:22.706737+0000","last_undegraded":"2024-08-17T02:27:22.706737+0000","last_fullsized":"2024-08-17T02:27:22.706737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710030+0000","last_change":"2024-08-17T02:27:21.678821+0000","last_active":"2024-08-17T02:27:22.710030+0000","last_peered":"2024-08-17T02:27:22.710030+0000","last_clean":"2024-08-17T02:27:22.710030+0000","last_became_active":"2024-08-17T02:27:21.678526+0000","last_became_peered":"2024-08-17T02:27:21.678526+0000","last_unstale":"2024-08-17T02:27:22.710030+0000","last_undegraded":"2024-08-17T02:27:22.710030+0000","last_fullsized":"2024-08-17T02:27:22.710030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:08.424907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707059+0000","last_change":"2024-08-17T02:27:22.703460+0000","last_active":"2024-08-17T02:27:22.707059+0000","last_peered":"2024-08-17T02:27:22.707059+0000","last_clean":"2024-08-17T02:27:22.707059+0000","last_became_active":"2024-08-17T02:27:22.703160+0000","last_became_peered":"2024-08-17T02:27:22.703160+0000","last_unstale":"2024-08-17T02:27:22.707059+0000","last_undegraded":"2024-08-17T02:27:22.707059+0000","last_fullsized":"2024-08-17T02:27:22.707059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:06.070316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710345+0000","last_change":"2024-08-17T02:27:22.707465+0000","last_active":"2024-08-17T02:27:22.710345+0000","last_peered":"2024-08-17T02:27:22.710345+0000","last_clean":"2024-08-17T02:27:22.710345+0000","last_became_active":"2024-08-17T02:27:22.707187+0000","last_became_peered":"2024-08-17T02:27:22.707187+0000","last_unstale":"2024-08-17T02:27:22.710345+0000","last_undegraded":"2024-08-17T02:27:22.710345+0000","last_fullsized":"2024-08-17T02:27:22.710345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:54.375406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710322+0000","last_change":"2024-08-17T02:27:21.684023+0000","last_active":"2024-08-17T02:27:22.710322+0000","last_peered":"2024-08-17T02:27:22.710322+0000","last_clean":"2024-08-17T02:27:22.710322+0000","last_became_active":"2024-08-17T02:27:21.683523+0000","last_became_peered":"2024-08-17T02:27:21.683523+0000","last_unstale":"2024-08-17T02:27:22.710322+0000","last_undegraded":"2024-08-17T02:27:22.710322+0000","last_fullsized":"2024-08-17T02:27:22.710322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:01.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717622+0000","last_change":"2024-08-17T02:27:22.715898+0000","last_active":"2024-08-17T02:27:22.717622+0000","last_peered":"2024-08-17T02:27:22.717622+0000","last_clean":"2024-08-17T02:27:22.717622+0000","last_became_active":"2024-08-17T02:27:22.715593+0000","last_became_peered":"2024-08-17T02:27:22.715593+0000","last_unstale":"2024-08-17T02:27:22.717622+0000","last_undegraded":"2024-08-17T02:27:22.717622+0000","last_fullsized":"2024-08-17T02:27:22.717622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:07.864704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714250+0000","last_change":"2024-08-17T02:27:21.679701+0000","last_active":"2024-08-17T02:27:22.714250+0000","last_peered":"2024-08-17T02:27:22.714250+0000","last_clean":"2024-08-17T02:27:22.714250+0000","last_became_active":"2024-08-17T02:27:21.679276+0000","last_became_peered":"2024-08-17T02:27:21.679276+0000","last_unstale":"2024-08-17T02:27:22.714250+0000","last_undegraded":"2024-08-17T02:27:22.714250+0000","last_fullsized":"2024-08-17T02:27:22.714250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:06.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719485+0000","last_change":"2024-08-17T02:27:22.715682+0000","last_active":"2024-08-17T02:27:22.719485+0000","last_peered":"2024-08-17T02:27:22.719485+0000","last_clean":"2024-08-17T02:27:22.719485+0000","last_became_active":"2024-08-17T02:27:22.714110+0000","last_became_peered":"2024-08-17T02:27:22.714110+0000","last_unstale":"2024-08-17T02:27:22.719485+0000","last_undegraded":"2024-08-17T02:27:22.719485+0000","last_fullsized":"2024-08-17T02:27:22.719485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718562+0000","last_change":"2024-08-17T02:27:21.676227+0000","last_active":"2024-08-17T02:27:22.718562+0000","last_peered":"2024-08-17T02:27:22.718562+0000","last_clean":"2024-08-17T02:27:22.718562+0000","last_became_active":"2024-08-17T02:27:21.675914+0000","last_became_peered":"2024-08-17T02:27:21.675914+0000","last_unstale":"2024-08-17T02:27:22.718562+0000","last_undegraded":"2024-08-17T02:27:22.718562+0000","last_fullsized":"2024-08-17T02:27:22.718562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718657+0000","last_change":"2024-08-17T02:27:22.713584+0000","last_active":"2024-08-17T02:27:22.718657+0000","last_peered":"2024-08-17T02:27:22.718657+0000","last_clean":"2024-08-17T02:27:22.718657+0000","last_became_active":"2024-08-17T02:27:22.710898+0000","last_became_peered":"2024-08-17T02:27:22.710898+0000","last_unstale":"2024-08-17T02:27:22.718657+0000","last_undegraded":"2024-08-17T02:27:22.718657+0000","last_fullsized":"2024-08-17T02:27:22.718657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718550+0000","last_change":"2024-08-17T02:27:21.683370+0000","last_active":"2024-08-17T02:27:22.718550+0000","last_peered":"2024-08-17T02:27:22.718550+0000","last_clean":"2024-08-17T02:27:22.718550+0000","last_became_active":"2024-08-17T02:27:21.683066+0000","last_became_peered":"2024-08-17T02:27:21.683066+0000","last_unstale":"2024-08-17T02:27:22.718550+0000","last_undegraded":"2024-08-17T02:27:22.718550+0000","last_fullsized":"2024-08-17T02:27:22.718550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":73913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":663238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":76001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":811008,"data_stored":664227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:32.554 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:32.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.648+0000 7f1570f71700 1 Processor -- start 2024-08-17T02:27:32.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.648+0000 7f1570f71700 1 -- start start 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f156c06df10 0x7f156c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0af2b0 con 0x7f156c155d20 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b07a0 con 0x7f156c06df10 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c06e8d0 con 0x7f156c0b0350 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f156c06df10 0x7f156c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f156c06df10 0x7f156c06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50320/0 (socket says 172.21.15.155:50320) 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 -- 172.21.15.155:0/1252189512 learned_addr learned my addr 172.21.15.155:0/1252189512 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156affd700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 -- 172.21.15.155:0/1252189512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 msgr2=0x7f156c0ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c0ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 -- 172.21.15.155:0/1252189512 >> v1:172.21.15.189:6789/0 conn(0x7f156c155d20 legacy=0x7f156c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 -- 172.21.15.155:0/1252189512 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0af590 con 0x7f156c06df10 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156bfff700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c06df10 0x7f156c06e390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1564009f50 tx=0x7f1564009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a313affab6c0c260 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156a7fc700 1 -- 172.21.15.155:0/1252189512 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400e070 con 0x7f156c06df10 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156a7fc700 1 -- 172.21.15.155:0/1252189512 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156400ba70 con 0x7f156c06df10 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f156a7fc700 1 -- 172.21.15.155:0/1252189512 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640092e0 con 0x7f156c06df10 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- 172.21.15.155:0/1252189512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c06df10 msgr2=0x7f156c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c06df10 0x7f156c06e390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1564009f50 tx=0x7f1564009840 comp rx=0 tx=0).stop 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- 172.21.15.155:0/1252189512 shutdown_connections 2024-08-17T02:27:32.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c0ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 --2- 172.21.15.155:0/1252189512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c06df10 0x7f156c06e390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- 172.21.15.155:0/1252189512 >> 172.21.15.155:0/1252189512 conn(0x7f156c0678d0 msgr2=0x7f156c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- 172.21.15.155:0/1252189512 shutdown_connections 2024-08-17T02:27:32.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.652+0000 7f1570f71700 1 -- 172.21.15.155:0/1252189512 wait complete. 2024-08-17T02:27:32.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 Processor -- start 2024-08-17T02:27:32.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- start start 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f156c06df10 0x7f156c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c1678b0 con 0x7f156c155d20 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c167b90 con 0x7f156c06df10 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c167e70 con 0x7f156c0b0350 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50324/0 (socket says 172.21.15.155:50324) 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 -- 172.21.15.155:0/756650582 learned_addr learned my addr 172.21.15.155:0/756650582 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:32.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156affd700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156b7fe700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f156c06df10 0x7f156c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 -- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 msgr2=0x7f156c147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 -- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f156c06df10 msgr2=0x7f156c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f156c06df10 0x7f156c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 -- 172.21.15.155:0/756650582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009ae0 con 0x7f156c155d20 2024-08-17T02:27:32.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f156bfff700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f156c06c2d0 tx=0x7f1564018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640032f0 con 0x7f156c155d20 2024-08-17T02:27:32.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564008d90 con 0x7f156c155d20 2024-08-17T02:27:32.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c168150 con 0x7f156c155d20 2024-08-17T02:27:32.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564026690 con 0x7f156c155d20 2024-08-17T02:27:32.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.656+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c167450 con 0x7f156c155d20 2024-08-17T02:27:32.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c0643a0 con 0x7f156c155d20 2024-08-17T02:27:32.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1564003040 con 0x7f156c155d20 2024-08-17T02:27:32.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f15537fe700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 0x7f1558062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f156407ec00 con 0x7f156c155d20 2024-08-17T02:27:32.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f156b7fe700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 0x7f1558062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.660+0000 7f156b7fe700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 0x7f1558062d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f155c0037c0 tx=0x7f155c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.668+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f156404efb0 con 0x7f156c155d20 2024-08-17T02:27:32.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.816+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f156c167d00 con 0x7f1558060890 2024-08-17T02:27:32.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.828+0000 7f15537fe700 1 -- 172.21.15.155:0/756650582 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264440 (secure 0 0 0) 0x7f156c167d00 con 0x7f1558060890 2024-08-17T02:27:32.835 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 msgr2=0x7f1558062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 0x7f1558062d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f155c0037c0 tx=0x7f155c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 msgr2=0x7f156c146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f156c06c2d0 tx=0x7f1564018000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 shutdown_connections 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1558060890 0x7f1558062d40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f156c155d20 0x7f156c146620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f156c0b0350 0x7f156c147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 --2- 172.21.15.155:0/756650582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f156c06df10 0x7f156c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 >> 172.21.15.155:0/756650582 conn(0x7f156c0678d0 msgr2=0x7f156c1535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 shutdown_connections 2024-08-17T02:27:32.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.832+0000 7f1570f71700 1 -- 172.21.15.155:0/756650582 wait complete. 2024-08-17T02:27:32.838 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:27:32.848 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:31.940432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385904,"kb_used_data":2884,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588816,"statfs":{"total":773094113280,"available":770650947584,"internally_reserved":0,"allocated":2953216,"data_stored":1774713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.258677"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714539+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.714539+0000","last_peered":"2024-08-17T02:27:22.714539+0000","last_clean":"2024-08-17T02:27:22.714539+0000","last_became_active":"2024-08-17T02:27:22.709948+0000","last_became_peered":"2024-08-17T02:27:22.709948+0000","last_unstale":"2024-08-17T02:27:22.714539+0000","last_undegraded":"2024-08-17T02:27:22.714539+0000","last_fullsized":"2024-08-17T02:27:22.714539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:31.256882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718042+0000","last_change":"2024-08-17T02:27:22.713233+0000","last_active":"2024-08-17T02:27:22.718042+0000","last_peered":"2024-08-17T02:27:22.718042+0000","last_clean":"2024-08-17T02:27:22.718042+0000","last_became_active":"2024-08-17T02:27:22.712342+0000","last_became_peered":"2024-08-17T02:27:22.712342+0000","last_unstale":"2024-08-17T02:27:22.718042+0000","last_undegraded":"2024-08-17T02:27:22.718042+0000","last_fullsized":"2024-08-17T02:27:22.718042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:47.644721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724729+0000","last_change":"2024-08-17T02:27:22.720583+0000","last_active":"2024-08-17T02:27:22.724729+0000","last_peered":"2024-08-17T02:27:22.724729+0000","last_clean":"2024-08-17T02:27:22.724729+0000","last_became_active":"2024-08-17T02:27:22.720240+0000","last_became_peered":"2024-08-17T02:27:22.720240+0000","last_unstale":"2024-08-17T02:27:22.724729+0000","last_undegraded":"2024-08-17T02:27:22.724729+0000","last_fullsized":"2024-08-17T02:27:22.724729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716830+0000","last_change":"2024-08-17T02:27:22.715254+0000","last_active":"2024-08-17T02:27:22.716830+0000","last_peered":"2024-08-17T02:27:22.716830+0000","last_clean":"2024-08-17T02:27:22.716830+0000","last_became_active":"2024-08-17T02:27:22.714973+0000","last_became_peered":"2024-08-17T02:27:22.714973+0000","last_unstale":"2024-08-17T02:27:22.716830+0000","last_undegraded":"2024-08-17T02:27:22.716830+0000","last_fullsized":"2024-08-17T02:27:22.716830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:28.901609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722056+0000","last_change":"2024-08-17T02:27:22.718174+0000","last_active":"2024-08-17T02:27:22.722056+0000","last_peered":"2024-08-17T02:27:22.722056+0000","last_clean":"2024-08-17T02:27:22.722056+0000","last_became_active":"2024-08-17T02:27:22.715180+0000","last_became_peered":"2024-08-17T02:27:22.715180+0000","last_unstale":"2024-08-17T02:27:22.722056+0000","last_undegraded":"2024-08-17T02:27:22.722056+0000","last_fullsized":"2024-08-17T02:27:22.722056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:33:00.741989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714252+0000","last_change":"2024-08-17T02:27:22.713445+0000","last_active":"2024-08-17T02:27:22.714252+0000","last_peered":"2024-08-17T02:27:22.714252+0000","last_clean":"2024-08-17T02:27:22.714252+0000","last_became_active":"2024-08-17T02:27:22.713175+0000","last_became_peered":"2024-08-17T02:27:22.713175+0000","last_unstale":"2024-08-17T02:27:22.714252+0000","last_undegraded":"2024-08-17T02:27:22.714252+0000","last_fullsized":"2024-08-17T02:27:22.714252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:54.337887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722435+0000","last_change":"2024-08-17T02:27:22.719534+0000","last_active":"2024-08-17T02:27:22.722435+0000","last_peered":"2024-08-17T02:27:22.722435+0000","last_clean":"2024-08-17T02:27:22.722435+0000","last_became_active":"2024-08-17T02:27:22.719271+0000","last_became_peered":"2024-08-17T02:27:22.719271+0000","last_unstale":"2024-08-17T02:27:22.722435+0000","last_undegraded":"2024-08-17T02:27:22.722435+0000","last_fullsized":"2024-08-17T02:27:22.722435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:17.620613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.724689+0000","last_change":"2024-08-17T02:27:22.719409+0000","last_active":"2024-08-17T02:27:22.724689+0000","last_peered":"2024-08-17T02:27:22.724689+0000","last_clean":"2024-08-17T02:27:22.724689+0000","last_became_active":"2024-08-17T02:27:22.718966+0000","last_became_peered":"2024-08-17T02:27:22.718966+0000","last_unstale":"2024-08-17T02:27:22.724689+0000","last_undegraded":"2024-08-17T02:27:22.724689+0000","last_fullsized":"2024-08-17T02:27:22.724689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:12.695037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711289+0000","last_change":"2024-08-17T02:27:22.708900+0000","last_active":"2024-08-17T02:27:22.711289+0000","last_peered":"2024-08-17T02:27:22.711289+0000","last_clean":"2024-08-17T02:27:22.711289+0000","last_became_active":"2024-08-17T02:27:22.708639+0000","last_became_peered":"2024-08-17T02:27:22.708639+0000","last_unstale":"2024-08-17T02:27:22.711289+0000","last_undegraded":"2024-08-17T02:27:22.711289+0000","last_fullsized":"2024-08-17T02:27:22.711289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:28.298093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722437+0000","last_change":"2024-08-17T02:27:22.718947+0000","last_active":"2024-08-17T02:27:22.722437+0000","last_peered":"2024-08-17T02:27:22.722437+0000","last_clean":"2024-08-17T02:27:22.722437+0000","last_became_active":"2024-08-17T02:27:22.718468+0000","last_became_peered":"2024-08-17T02:27:22.718468+0000","last_unstale":"2024-08-17T02:27:22.722437+0000","last_undegraded":"2024-08-17T02:27:22.722437+0000","last_fullsized":"2024-08-17T02:27:22.722437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:33.020825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721960+0000","last_change":"2024-08-17T02:27:22.714887+0000","last_active":"2024-08-17T02:27:22.721960+0000","last_peered":"2024-08-17T02:27:22.721960+0000","last_clean":"2024-08-17T02:27:22.721960+0000","last_became_active":"2024-08-17T02:27:22.714523+0000","last_became_peered":"2024-08-17T02:27:22.714523+0000","last_unstale":"2024-08-17T02:27:22.721960+0000","last_undegraded":"2024-08-17T02:27:22.721960+0000","last_fullsized":"2024-08-17T02:27:22.721960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:06:07.993888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714583+0000","last_change":"2024-08-17T02:27:22.705954+0000","last_active":"2024-08-17T02:27:22.714583+0000","last_peered":"2024-08-17T02:27:22.714583+0000","last_clean":"2024-08-17T02:27:22.714583+0000","last_became_active":"2024-08-17T02:27:22.705129+0000","last_became_peered":"2024-08-17T02:27:22.705129+0000","last_unstale":"2024-08-17T02:27:22.714583+0000","last_undegraded":"2024-08-17T02:27:22.714583+0000","last_fullsized":"2024-08-17T02:27:22.714583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:36.875628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713100+0000","last_change":"2024-08-17T02:27:22.711703+0000","last_active":"2024-08-17T02:27:22.713100+0000","last_peered":"2024-08-17T02:27:22.713100+0000","last_clean":"2024-08-17T02:27:22.713100+0000","last_became_active":"2024-08-17T02:27:22.711350+0000","last_became_peered":"2024-08-17T02:27:22.711350+0000","last_unstale":"2024-08-17T02:27:22.713100+0000","last_undegraded":"2024-08-17T02:27:22.713100+0000","last_fullsized":"2024-08-17T02:27:22.713100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:28.003477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707981+0000","last_change":"2024-08-17T02:27:22.702614+0000","last_active":"2024-08-17T02:27:22.707981+0000","last_peered":"2024-08-17T02:27:22.707981+0000","last_clean":"2024-08-17T02:27:22.707981+0000","last_became_active":"2024-08-17T02:27:22.702337+0000","last_became_peered":"2024-08-17T02:27:22.702337+0000","last_unstale":"2024-08-17T02:27:22.707981+0000","last_undegraded":"2024-08-17T02:27:22.707981+0000","last_fullsized":"2024-08-17T02:27:22.707981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:07:22.333869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719804+0000","last_change":"2024-08-17T02:27:22.716233+0000","last_active":"2024-08-17T02:27:22.719804+0000","last_peered":"2024-08-17T02:27:22.719804+0000","last_clean":"2024-08-17T02:27:22.719804+0000","last_became_active":"2024-08-17T02:27:22.715931+0000","last_became_peered":"2024-08-17T02:27:22.715931+0000","last_unstale":"2024-08-17T02:27:22.719804+0000","last_undegraded":"2024-08-17T02:27:22.719804+0000","last_fullsized":"2024-08-17T02:27:22.719804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709764+0000","last_change":"2024-08-17T02:27:22.706621+0000","last_active":"2024-08-17T02:27:22.709764+0000","last_peered":"2024-08-17T02:27:22.709764+0000","last_clean":"2024-08-17T02:27:22.709764+0000","last_became_active":"2024-08-17T02:27:22.705085+0000","last_became_peered":"2024-08-17T02:27:22.705085+0000","last_unstale":"2024-08-17T02:27:22.709764+0000","last_undegraded":"2024-08-17T02:27:22.709764+0000","last_fullsized":"2024-08-17T02:27:22.709764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:05.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711957+0000","last_change":"2024-08-17T02:27:22.707866+0000","last_active":"2024-08-17T02:27:22.711957+0000","last_peered":"2024-08-17T02:27:22.711957+0000","last_clean":"2024-08-17T02:27:22.711957+0000","last_became_active":"2024-08-17T02:27:22.707509+0000","last_became_peered":"2024-08-17T02:27:22.707509+0000","last_unstale":"2024-08-17T02:27:22.711957+0000","last_undegraded":"2024-08-17T02:27:22.711957+0000","last_fullsized":"2024-08-17T02:27:22.711957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:50.650639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.701747+0000","last_change":"2024-08-17T02:27:22.692819+0000","last_active":"2024-08-17T02:27:22.701747+0000","last_peered":"2024-08-17T02:27:22.701747+0000","last_clean":"2024-08-17T02:27:22.701747+0000","last_became_active":"2024-08-17T02:27:22.692445+0000","last_became_peered":"2024-08-17T02:27:22.692445+0000","last_unstale":"2024-08-17T02:27:22.701747+0000","last_undegraded":"2024-08-17T02:27:22.701747+0000","last_fullsized":"2024-08-17T02:27:22.701747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714077+0000","last_change":"2024-08-17T02:27:22.713391+0000","last_active":"2024-08-17T02:27:22.714077+0000","last_peered":"2024-08-17T02:27:22.714077+0000","last_clean":"2024-08-17T02:27:22.714077+0000","last_became_active":"2024-08-17T02:27:22.713117+0000","last_became_peered":"2024-08-17T02:27:22.713117+0000","last_unstale":"2024-08-17T02:27:22.714077+0000","last_undegraded":"2024-08-17T02:27:22.714077+0000","last_fullsized":"2024-08-17T02:27:22.714077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:23.685025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714600+0000","last_change":"2024-08-17T02:27:22.706145+0000","last_active":"2024-08-17T02:27:22.714600+0000","last_peered":"2024-08-17T02:27:22.714600+0000","last_clean":"2024-08-17T02:27:22.714600+0000","last_became_active":"2024-08-17T02:27:22.705632+0000","last_became_peered":"2024-08-17T02:27:22.705632+0000","last_unstale":"2024-08-17T02:27:22.714600+0000","last_undegraded":"2024-08-17T02:27:22.714600+0000","last_fullsized":"2024-08-17T02:27:22.714600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.808731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719617+0000","last_change":"2024-08-17T02:27:22.713685+0000","last_active":"2024-08-17T02:27:22.719617+0000","last_peered":"2024-08-17T02:27:22.719617+0000","last_clean":"2024-08-17T02:27:22.719617+0000","last_became_active":"2024-08-17T02:27:22.713406+0000","last_became_peered":"2024-08-17T02:27:22.713406+0000","last_unstale":"2024-08-17T02:27:22.719617+0000","last_undegraded":"2024-08-17T02:27:22.719617+0000","last_fullsized":"2024-08-17T02:27:22.719617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712608+0000","last_change":"2024-08-17T02:27:22.711278+0000","last_active":"2024-08-17T02:27:22.712608+0000","last_peered":"2024-08-17T02:27:22.712608+0000","last_clean":"2024-08-17T02:27:22.712608+0000","last_became_active":"2024-08-17T02:27:22.710945+0000","last_became_peered":"2024-08-17T02:27:22.710945+0000","last_unstale":"2024-08-17T02:27:22.712608+0000","last_undegraded":"2024-08-17T02:27:22.712608+0000","last_fullsized":"2024-08-17T02:27:22.712608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719769+0000","last_change":"2024-08-17T02:27:22.716220+0000","last_active":"2024-08-17T02:27:22.719769+0000","last_peered":"2024-08-17T02:27:22.719769+0000","last_clean":"2024-08-17T02:27:22.719769+0000","last_became_active":"2024-08-17T02:27:22.714375+0000","last_became_peered":"2024-08-17T02:27:22.714375+0000","last_unstale":"2024-08-17T02:27:22.719769+0000","last_undegraded":"2024-08-17T02:27:22.719769+0000","last_fullsized":"2024-08-17T02:27:22.719769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:51.976961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717283+0000","last_change":"2024-08-17T02:27:22.716173+0000","last_active":"2024-08-17T02:27:22.717283+0000","last_peered":"2024-08-17T02:27:22.717283+0000","last_clean":"2024-08-17T02:27:22.717283+0000","last_became_active":"2024-08-17T02:27:22.715892+0000","last_became_peered":"2024-08-17T02:27:22.715892+0000","last_unstale":"2024-08-17T02:27:22.717283+0000","last_undegraded":"2024-08-17T02:27:22.717283+0000","last_fullsized":"2024-08-17T02:27:22.717283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:02.262851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719843+0000","last_change":"2024-08-17T02:27:22.716737+0000","last_active":"2024-08-17T02:27:22.719843+0000","last_peered":"2024-08-17T02:27:22.719843+0000","last_clean":"2024-08-17T02:27:22.719843+0000","last_became_active":"2024-08-17T02:27:22.715984+0000","last_became_peered":"2024-08-17T02:27:22.715984+0000","last_unstale":"2024-08-17T02:27:22.719843+0000","last_undegraded":"2024-08-17T02:27:22.719843+0000","last_fullsized":"2024-08-17T02:27:22.719843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:02.516802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712777+0000","last_change":"2024-08-17T02:27:22.708044+0000","last_active":"2024-08-17T02:27:22.712777+0000","last_peered":"2024-08-17T02:27:22.712777+0000","last_clean":"2024-08-17T02:27:22.712777+0000","last_became_active":"2024-08-17T02:27:22.707573+0000","last_became_peered":"2024-08-17T02:27:22.707573+0000","last_unstale":"2024-08-17T02:27:22.712777+0000","last_undegraded":"2024-08-17T02:27:22.712777+0000","last_fullsized":"2024-08-17T02:27:22.712777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:48.395371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707359+0000","last_change":"2024-08-17T02:27:22.703317+0000","last_active":"2024-08-17T02:27:22.707359+0000","last_peered":"2024-08-17T02:27:22.707359+0000","last_clean":"2024-08-17T02:27:22.707359+0000","last_became_active":"2024-08-17T02:27:22.703015+0000","last_became_peered":"2024-08-17T02:27:22.703015+0000","last_unstale":"2024-08-17T02:27:22.707359+0000","last_undegraded":"2024-08-17T02:27:22.707359+0000","last_fullsized":"2024-08-17T02:27:22.707359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719147+0000","last_change":"2024-08-17T02:27:22.715163+0000","last_active":"2024-08-17T02:27:22.719147+0000","last_peered":"2024-08-17T02:27:22.719147+0000","last_clean":"2024-08-17T02:27:22.719147+0000","last_became_active":"2024-08-17T02:27:22.714822+0000","last_became_peered":"2024-08-17T02:27:22.714822+0000","last_unstale":"2024-08-17T02:27:22.719147+0000","last_undegraded":"2024-08-17T02:27:22.719147+0000","last_fullsized":"2024-08-17T02:27:22.719147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:16.375853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713814+0000","last_change":"2024-08-17T02:27:22.708377+0000","last_active":"2024-08-17T02:27:22.713814+0000","last_peered":"2024-08-17T02:27:22.713814+0000","last_clean":"2024-08-17T02:27:22.713814+0000","last_became_active":"2024-08-17T02:27:22.708110+0000","last_became_peered":"2024-08-17T02:27:22.708110+0000","last_unstale":"2024-08-17T02:27:22.713814+0000","last_undegraded":"2024-08-17T02:27:22.713814+0000","last_fullsized":"2024-08-17T02:27:22.713814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:00.145322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717346+0000","last_change":"2024-08-17T02:27:22.716325+0000","last_active":"2024-08-17T02:27:22.717346+0000","last_peered":"2024-08-17T02:27:22.717346+0000","last_clean":"2024-08-17T02:27:22.717346+0000","last_became_active":"2024-08-17T02:27:22.715973+0000","last_became_peered":"2024-08-17T02:27:22.715973+0000","last_unstale":"2024-08-17T02:27:22.717346+0000","last_undegraded":"2024-08-17T02:27:22.717346+0000","last_fullsized":"2024-08-17T02:27:22.717346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:10.581368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706793+0000","last_change":"2024-08-17T02:27:22.702498+0000","last_active":"2024-08-17T02:27:22.706793+0000","last_peered":"2024-08-17T02:27:22.706793+0000","last_clean":"2024-08-17T02:27:22.706793+0000","last_became_active":"2024-08-17T02:27:22.702167+0000","last_became_peered":"2024-08-17T02:27:22.702167+0000","last_unstale":"2024-08-17T02:27:22.706793+0000","last_undegraded":"2024-08-17T02:27:22.706793+0000","last_fullsized":"2024-08-17T02:27:22.706793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:04.036357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.709416+0000","last_change":"2024-08-17T02:27:22.704139+0000","last_active":"2024-08-17T02:27:22.709416+0000","last_peered":"2024-08-17T02:27:22.709416+0000","last_clean":"2024-08-17T02:27:22.709416+0000","last_became_active":"2024-08-17T02:27:22.703169+0000","last_became_peered":"2024-08-17T02:27:22.703169+0000","last_unstale":"2024-08-17T02:27:22.709416+0000","last_undegraded":"2024-08-17T02:27:22.709416+0000","last_fullsized":"2024-08-17T02:27:22.709416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716771+0000","last_change":"2024-08-17T02:27:22.715481+0000","last_active":"2024-08-17T02:27:22.716771+0000","last_peered":"2024-08-17T02:27:22.716771+0000","last_clean":"2024-08-17T02:27:22.716771+0000","last_became_active":"2024-08-17T02:27:22.715124+0000","last_became_peered":"2024-08-17T02:27:22.715124+0000","last_unstale":"2024-08-17T02:27:22.716771+0000","last_undegraded":"2024-08-17T02:27:22.716771+0000","last_fullsized":"2024-08-17T02:27:22.716771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715671+0000","last_change":"2024-08-17T02:27:21.681341+0000","last_active":"2024-08-17T02:27:22.715671+0000","last_peered":"2024-08-17T02:27:22.715671+0000","last_clean":"2024-08-17T02:27:22.715671+0000","last_became_active":"2024-08-17T02:27:21.681038+0000","last_became_peered":"2024-08-17T02:27:21.681038+0000","last_unstale":"2024-08-17T02:27:22.715671+0000","last_undegraded":"2024-08-17T02:27:22.715671+0000","last_fullsized":"2024-08-17T02:27:22.715671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:59:25.398120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.723868+0000","last_change":"2024-08-17T02:27:22.722197+0000","last_active":"2024-08-17T02:27:22.723868+0000","last_peered":"2024-08-17T02:27:22.723868+0000","last_clean":"2024-08-17T02:27:22.723868+0000","last_became_active":"2024-08-17T02:27:22.721882+0000","last_became_peered":"2024-08-17T02:27:22.721882+0000","last_unstale":"2024-08-17T02:27:22.723868+0000","last_undegraded":"2024-08-17T02:27:22.723868+0000","last_fullsized":"2024-08-17T02:27:22.723868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712031+0000","last_change":"2024-08-17T02:27:21.681865+0000","last_active":"2024-08-17T02:27:22.712031+0000","last_peered":"2024-08-17T02:27:22.712031+0000","last_clean":"2024-08-17T02:27:22.712031+0000","last_became_active":"2024-08-17T02:27:21.681071+0000","last_became_peered":"2024-08-17T02:27:21.681071+0000","last_unstale":"2024-08-17T02:27:22.712031+0000","last_undegraded":"2024-08-17T02:27:22.712031+0000","last_fullsized":"2024-08-17T02:27:22.712031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:47.386952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694890+0000","last_change":"2024-08-17T02:27:21.681027+0000","last_active":"2024-08-17T02:27:22.694890+0000","last_peered":"2024-08-17T02:27:22.694890+0000","last_clean":"2024-08-17T02:27:22.694890+0000","last_became_active":"2024-08-17T02:27:21.680738+0000","last_became_peered":"2024-08-17T02:27:21.680738+0000","last_unstale":"2024-08-17T02:27:22.694890+0000","last_undegraded":"2024-08-17T02:27:22.694890+0000","last_fullsized":"2024-08-17T02:27:22.694890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.716007+0000","last_change":"2024-08-17T02:27:22.711080+0000","last_active":"2024-08-17T02:27:22.716007+0000","last_peered":"2024-08-17T02:27:22.716007+0000","last_clean":"2024-08-17T02:27:22.716007+0000","last_became_active":"2024-08-17T02:27:22.710758+0000","last_became_peered":"2024-08-17T02:27:22.710758+0000","last_unstale":"2024-08-17T02:27:22.716007+0000","last_undegraded":"2024-08-17T02:27:22.716007+0000","last_fullsized":"2024-08-17T02:27:22.716007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:23.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688653+0000","last_change":"2024-08-17T02:27:21.683107+0000","last_active":"2024-08-17T02:27:22.688653+0000","last_peered":"2024-08-17T02:27:22.688653+0000","last_clean":"2024-08-17T02:27:22.688653+0000","last_became_active":"2024-08-17T02:27:21.682425+0000","last_became_peered":"2024-08-17T02:27:21.682425+0000","last_unstale":"2024-08-17T02:27:22.688653+0000","last_undegraded":"2024-08-17T02:27:22.688653+0000","last_fullsized":"2024-08-17T02:27:22.688653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:44.884474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718332+0000","last_change":"2024-08-17T02:27:22.707768+0000","last_active":"2024-08-17T02:27:22.718332+0000","last_peered":"2024-08-17T02:27:22.718332+0000","last_clean":"2024-08-17T02:27:22.718332+0000","last_became_active":"2024-08-17T02:27:22.704583+0000","last_became_peered":"2024-08-17T02:27:22.704583+0000","last_unstale":"2024-08-17T02:27:22.718332+0000","last_undegraded":"2024-08-17T02:27:22.718332+0000","last_fullsized":"2024-08-17T02:27:22.718332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.697955+0000","last_change":"2024-08-17T02:27:21.675353+0000","last_active":"2024-08-17T02:27:22.697955+0000","last_peered":"2024-08-17T02:27:22.697955+0000","last_clean":"2024-08-17T02:27:22.697955+0000","last_became_active":"2024-08-17T02:27:21.675012+0000","last_became_peered":"2024-08-17T02:27:21.675012+0000","last_unstale":"2024-08-17T02:27:22.697955+0000","last_undegraded":"2024-08-17T02:27:22.697955+0000","last_fullsized":"2024-08-17T02:27:22.697955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.729709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712879+0000","last_change":"2024-08-17T02:27:22.709387+0000","last_active":"2024-08-17T02:27:22.712879+0000","last_peered":"2024-08-17T02:27:22.712879+0000","last_clean":"2024-08-17T02:27:22.712879+0000","last_became_active":"2024-08-17T02:27:22.708326+0000","last_became_peered":"2024-08-17T02:27:22.708326+0000","last_unstale":"2024-08-17T02:27:22.712879+0000","last_undegraded":"2024-08-17T02:27:22.712879+0000","last_fullsized":"2024-08-17T02:27:22.712879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:18.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702030+0000","last_change":"2024-08-17T02:27:21.683255+0000","last_active":"2024-08-17T02:27:22.702030+0000","last_peered":"2024-08-17T02:27:22.702030+0000","last_clean":"2024-08-17T02:27:22.702030+0000","last_became_active":"2024-08-17T02:27:21.682833+0000","last_became_peered":"2024-08-17T02:27:21.682833+0000","last_unstale":"2024-08-17T02:27:22.702030+0000","last_undegraded":"2024-08-17T02:27:22.702030+0000","last_fullsized":"2024-08-17T02:27:22.702030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:32.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.713451+0000","last_change":"2024-08-17T02:27:22.707536+0000","last_active":"2024-08-17T02:27:22.713451+0000","last_peered":"2024-08-17T02:27:22.713451+0000","last_clean":"2024-08-17T02:27:22.713451+0000","last_became_active":"2024-08-17T02:27:22.705906+0000","last_became_peered":"2024-08-17T02:27:22.705906+0000","last_unstale":"2024-08-17T02:27:22.713451+0000","last_undegraded":"2024-08-17T02:27:22.713451+0000","last_fullsized":"2024-08-17T02:27:22.713451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:44.554675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.705771+0000","last_change":"2024-08-17T02:27:21.679646+0000","last_active":"2024-08-17T02:27:22.705771+0000","last_peered":"2024-08-17T02:27:22.705771+0000","last_clean":"2024-08-17T02:27:22.705771+0000","last_became_active":"2024-08-17T02:27:21.679295+0000","last_became_peered":"2024-08-17T02:27:21.679295+0000","last_unstale":"2024-08-17T02:27:22.705771+0000","last_undegraded":"2024-08-17T02:27:22.705771+0000","last_fullsized":"2024-08-17T02:27:22.705771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.061409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706909+0000","last_change":"2024-08-17T02:27:22.703760+0000","last_active":"2024-08-17T02:27:22.706909+0000","last_peered":"2024-08-17T02:27:22.706909+0000","last_clean":"2024-08-17T02:27:22.706909+0000","last_became_active":"2024-08-17T02:27:22.703453+0000","last_became_peered":"2024-08-17T02:27:22.703453+0000","last_unstale":"2024-08-17T02:27:22.706909+0000","last_undegraded":"2024-08-17T02:27:22.706909+0000","last_fullsized":"2024-08-17T02:27:22.706909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720580+0000","last_change":"2024-08-17T02:27:21.679961+0000","last_active":"2024-08-17T02:27:22.720580+0000","last_peered":"2024-08-17T02:27:22.720580+0000","last_clean":"2024-08-17T02:27:22.720580+0000","last_became_active":"2024-08-17T02:27:21.679617+0000","last_became_peered":"2024-08-17T02:27:21.679617+0000","last_unstale":"2024-08-17T02:27:22.720580+0000","last_undegraded":"2024-08-17T02:27:22.720580+0000","last_fullsized":"2024-08-17T02:27:22.720580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:48.033291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714770+0000","last_change":"2024-08-17T02:27:22.706055+0000","last_active":"2024-08-17T02:27:22.714770+0000","last_peered":"2024-08-17T02:27:22.714770+0000","last_clean":"2024-08-17T02:27:22.714770+0000","last_became_active":"2024-08-17T02:27:22.705762+0000","last_became_peered":"2024-08-17T02:27:22.705762+0000","last_unstale":"2024-08-17T02:27:22.714770+0000","last_undegraded":"2024-08-17T02:27:22.714770+0000","last_fullsized":"2024-08-17T02:27:22.714770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:10:34.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.702078+0000","last_change":"2024-08-17T02:27:21.682999+0000","last_active":"2024-08-17T02:27:22.702078+0000","last_peered":"2024-08-17T02:27:22.702078+0000","last_clean":"2024-08-17T02:27:22.702078+0000","last_became_active":"2024-08-17T02:27:21.682681+0000","last_became_peered":"2024-08-17T02:27:21.682681+0000","last_unstale":"2024-08-17T02:27:22.702078+0000","last_undegraded":"2024-08-17T02:27:22.702078+0000","last_fullsized":"2024-08-17T02:27:22.702078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:15.633223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711176+0000","last_change":"2024-08-17T02:27:22.706043+0000","last_active":"2024-08-17T02:27:22.711176+0000","last_peered":"2024-08-17T02:27:22.711176+0000","last_clean":"2024-08-17T02:27:22.711176+0000","last_became_active":"2024-08-17T02:27:22.705777+0000","last_became_peered":"2024-08-17T02:27:22.705777+0000","last_unstale":"2024-08-17T02:27:22.711176+0000","last_undegraded":"2024-08-17T02:27:22.711176+0000","last_fullsized":"2024-08-17T02:27:22.711176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:11:59.021896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688867+0000","last_change":"2024-08-17T02:27:21.677481+0000","last_active":"2024-08-17T02:27:22.688867+0000","last_peered":"2024-08-17T02:27:22.688867+0000","last_clean":"2024-08-17T02:27:22.688867+0000","last_became_active":"2024-08-17T02:27:21.676761+0000","last_became_peered":"2024-08-17T02:27:21.676761+0000","last_unstale":"2024-08-17T02:27:22.688867+0000","last_undegraded":"2024-08-17T02:27:22.688867+0000","last_fullsized":"2024-08-17T02:27:22.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:08.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.711894+0000","last_change":"2024-08-17T02:27:22.711222+0000","last_active":"2024-08-17T02:27:22.711894+0000","last_peered":"2024-08-17T02:27:22.711894+0000","last_clean":"2024-08-17T02:27:22.711894+0000","last_became_active":"2024-08-17T02:27:22.710967+0000","last_became_peered":"2024-08-17T02:27:22.710967+0000","last_unstale":"2024-08-17T02:27:22.711894+0000","last_undegraded":"2024-08-17T02:27:22.711894+0000","last_fullsized":"2024-08-17T02:27:22.711894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:43.683949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695550+0000","last_change":"2024-08-17T02:27:21.687679+0000","last_active":"2024-08-17T02:27:22.695550+0000","last_peered":"2024-08-17T02:27:22.695550+0000","last_clean":"2024-08-17T02:27:22.695550+0000","last_became_active":"2024-08-17T02:27:21.687401+0000","last_became_peered":"2024-08-17T02:27:21.687401+0000","last_unstale":"2024-08-17T02:27:22.695550+0000","last_undegraded":"2024-08-17T02:27:22.695550+0000","last_fullsized":"2024-08-17T02:27:22.695550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:38.795028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.720949+0000","last_change":"2024-08-17T02:27:22.719603+0000","last_active":"2024-08-17T02:27:22.720949+0000","last_peered":"2024-08-17T02:27:22.720949+0000","last_clean":"2024-08-17T02:27:22.720949+0000","last_became_active":"2024-08-17T02:27:22.719280+0000","last_became_peered":"2024-08-17T02:27:22.719280+0000","last_unstale":"2024-08-17T02:27:22.720949+0000","last_undegraded":"2024-08-17T02:27:22.720949+0000","last_fullsized":"2024-08-17T02:27:22.720949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:00.665160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719573+0000","last_change":"2024-08-17T02:27:21.679122+0000","last_active":"2024-08-17T02:27:22.719573+0000","last_peered":"2024-08-17T02:27:22.719573+0000","last_clean":"2024-08-17T02:27:22.719573+0000","last_became_active":"2024-08-17T02:27:21.678813+0000","last_became_peered":"2024-08-17T02:27:21.678813+0000","last_unstale":"2024-08-17T02:27:22.719573+0000","last_undegraded":"2024-08-17T02:27:22.719573+0000","last_fullsized":"2024-08-17T02:27:22.719573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706847+0000","last_change":"2024-08-17T02:27:22.703352+0000","last_active":"2024-08-17T02:27:22.706847+0000","last_peered":"2024-08-17T02:27:22.706847+0000","last_clean":"2024-08-17T02:27:22.706847+0000","last_became_active":"2024-08-17T02:27:22.703066+0000","last_became_peered":"2024-08-17T02:27:22.703066+0000","last_unstale":"2024-08-17T02:27:22.706847+0000","last_undegraded":"2024-08-17T02:27:22.706847+0000","last_fullsized":"2024-08-17T02:27:22.706847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:41.545412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718462+0000","last_change":"2024-08-17T02:27:21.684496+0000","last_active":"2024-08-17T02:27:22.718462+0000","last_peered":"2024-08-17T02:27:22.718462+0000","last_clean":"2024-08-17T02:27:22.718462+0000","last_became_active":"2024-08-17T02:27:21.684210+0000","last_became_peered":"2024-08-17T02:27:21.684210+0000","last_unstale":"2024-08-17T02:27:22.718462+0000","last_undegraded":"2024-08-17T02:27:22.718462+0000","last_fullsized":"2024-08-17T02:27:22.718462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:46.288307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712912+0000","last_change":"2024-08-17T02:27:22.710273+0000","last_active":"2024-08-17T02:27:22.712912+0000","last_peered":"2024-08-17T02:27:22.712912+0000","last_clean":"2024-08-17T02:27:22.712912+0000","last_became_active":"2024-08-17T02:27:22.709505+0000","last_became_peered":"2024-08-17T02:27:22.709505+0000","last_unstale":"2024-08-17T02:27:22.712912+0000","last_undegraded":"2024-08-17T02:27:22.712912+0000","last_fullsized":"2024-08-17T02:27:22.712912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:09.433325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714732+0000","last_change":"2024-08-17T02:27:21.676534+0000","last_active":"2024-08-17T02:27:22.714732+0000","last_peered":"2024-08-17T02:27:22.714732+0000","last_clean":"2024-08-17T02:27:22.714732+0000","last_became_active":"2024-08-17T02:27:21.676222+0000","last_became_peered":"2024-08-17T02:27:21.676222+0000","last_unstale":"2024-08-17T02:27:22.714732+0000","last_undegraded":"2024-08-17T02:27:22.714732+0000","last_fullsized":"2024-08-17T02:27:22.714732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:27.893191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714565+0000","last_change":"2024-08-17T02:27:22.710824+0000","last_active":"2024-08-17T02:27:22.714565+0000","last_peered":"2024-08-17T02:27:22.714565+0000","last_clean":"2024-08-17T02:27:22.714565+0000","last_became_active":"2024-08-17T02:27:22.710510+0000","last_became_peered":"2024-08-17T02:27:22.710510+0000","last_unstale":"2024-08-17T02:27:22.714565+0000","last_undegraded":"2024-08-17T02:27:22.714565+0000","last_fullsized":"2024-08-17T02:27:22.714565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:04.586592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717136+0000","last_change":"2024-08-17T02:27:21.682443+0000","last_active":"2024-08-17T02:27:22.717136+0000","last_peered":"2024-08-17T02:27:22.717136+0000","last_clean":"2024-08-17T02:27:22.717136+0000","last_became_active":"2024-08-17T02:27:21.682090+0000","last_became_peered":"2024-08-17T02:27:21.682090+0000","last_unstale":"2024-08-17T02:27:22.717136+0000","last_undegraded":"2024-08-17T02:27:22.717136+0000","last_fullsized":"2024-08-17T02:27:22.717136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.721878+0000","last_change":"2024-08-17T02:27:22.714014+0000","last_active":"2024-08-17T02:27:22.721878+0000","last_peered":"2024-08-17T02:27:22.721878+0000","last_clean":"2024-08-17T02:27:22.721878+0000","last_became_active":"2024-08-17T02:27:22.710360+0000","last_became_peered":"2024-08-17T02:27:22.710360+0000","last_unstale":"2024-08-17T02:27:22.721878+0000","last_undegraded":"2024-08-17T02:27:22.721878+0000","last_fullsized":"2024-08-17T02:27:22.721878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:13.548023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695461+0000","last_change":"2024-08-17T02:27:21.684019+0000","last_active":"2024-08-17T02:27:22.695461+0000","last_peered":"2024-08-17T02:27:22.695461+0000","last_clean":"2024-08-17T02:27:22.695461+0000","last_became_active":"2024-08-17T02:27:21.683698+0000","last_became_peered":"2024-08-17T02:27:21.683698+0000","last_unstale":"2024-08-17T02:27:22.695461+0000","last_undegraded":"2024-08-17T02:27:22.695461+0000","last_fullsized":"2024-08-17T02:27:22.695461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:24:13.363387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707656+0000","last_change":"2024-08-17T02:27:22.704813+0000","last_active":"2024-08-17T02:27:22.707656+0000","last_peered":"2024-08-17T02:27:22.707656+0000","last_clean":"2024-08-17T02:27:22.707656+0000","last_became_active":"2024-08-17T02:27:22.703693+0000","last_became_peered":"2024-08-17T02:27:22.703693+0000","last_unstale":"2024-08-17T02:27:22.707656+0000","last_undegraded":"2024-08-17T02:27:22.707656+0000","last_fullsized":"2024-08-17T02:27:22.707656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:43.268210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.698112+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:27:22.698112+0000","last_peered":"2024-08-17T02:27:22.698112+0000","last_clean":"2024-08-17T02:27:22.698112+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:27:22.698112+0000","last_undegraded":"2024-08-17T02:27:22.698112+0000","last_fullsized":"2024-08-17T02:27:22.698112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688750+0000","last_change":"2024-08-17T02:27:21.677758+0000","last_active":"2024-08-17T02:27:22.688750+0000","last_peered":"2024-08-17T02:27:22.688750+0000","last_clean":"2024-08-17T02:27:22.688750+0000","last_became_active":"2024-08-17T02:27:21.677435+0000","last_became_peered":"2024-08-17T02:27:21.677435+0000","last_unstale":"2024-08-17T02:27:22.688750+0000","last_undegraded":"2024-08-17T02:27:22.688750+0000","last_fullsized":"2024-08-17T02:27:22.688750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:17.811669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718263+0000","last_change":"2024-08-17T02:27:22.707547+0000","last_active":"2024-08-17T02:27:22.718263+0000","last_peered":"2024-08-17T02:27:22.718263+0000","last_clean":"2024-08-17T02:27:22.718263+0000","last_became_active":"2024-08-17T02:27:22.707067+0000","last_became_peered":"2024-08-17T02:27:22.707067+0000","last_unstale":"2024-08-17T02:27:22.718263+0000","last_undegraded":"2024-08-17T02:27:22.718263+0000","last_fullsized":"2024-08-17T02:27:22.718263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:54.622575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688823+0000","last_change":"2024-08-17T02:27:21.679784+0000","last_active":"2024-08-17T02:27:22.688823+0000","last_peered":"2024-08-17T02:27:22.688823+0000","last_clean":"2024-08-17T02:27:22.688823+0000","last_became_active":"2024-08-17T02:27:21.679452+0000","last_became_peered":"2024-08-17T02:27:21.679452+0000","last_unstale":"2024-08-17T02:27:22.688823+0000","last_undegraded":"2024-08-17T02:27:22.688823+0000","last_fullsized":"2024-08-17T02:27:22.688823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:59.136904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707149+0000","last_change":"2024-08-17T02:27:22.703264+0000","last_active":"2024-08-17T02:27:22.707149+0000","last_peered":"2024-08-17T02:27:22.707149+0000","last_clean":"2024-08-17T02:27:22.707149+0000","last_became_active":"2024-08-17T02:27:22.702948+0000","last_became_peered":"2024-08-17T02:27:22.702948+0000","last_unstale":"2024-08-17T02:27:22.707149+0000","last_undegraded":"2024-08-17T02:27:22.707149+0000","last_fullsized":"2024-08-17T02:27:22.707149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:25.930916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.688627+0000","last_change":"2024-08-17T02:27:21.679287+0000","last_active":"2024-08-17T02:27:22.688627+0000","last_peered":"2024-08-17T02:27:22.688627+0000","last_clean":"2024-08-17T02:27:22.688627+0000","last_became_active":"2024-08-17T02:27:21.678975+0000","last_became_peered":"2024-08-17T02:27:21.678975+0000","last_unstale":"2024-08-17T02:27:22.688627+0000","last_undegraded":"2024-08-17T02:27:22.688627+0000","last_fullsized":"2024-08-17T02:27:22.688627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717995+0000","last_change":"2024-08-17T02:27:22.713099+0000","last_active":"2024-08-17T02:27:22.717995+0000","last_peered":"2024-08-17T02:27:22.717995+0000","last_clean":"2024-08-17T02:27:22.717995+0000","last_became_active":"2024-08-17T02:27:22.712804+0000","last_became_peered":"2024-08-17T02:27:22.712804+0000","last_unstale":"2024-08-17T02:27:22.717995+0000","last_undegraded":"2024-08-17T02:27:22.717995+0000","last_fullsized":"2024-08-17T02:27:22.717995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:08.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689010+0000","last_change":"2024-08-17T02:27:21.682058+0000","last_active":"2024-08-17T02:27:22.689010+0000","last_peered":"2024-08-17T02:27:22.689010+0000","last_clean":"2024-08-17T02:27:22.689010+0000","last_became_active":"2024-08-17T02:27:21.681408+0000","last_became_peered":"2024-08-17T02:27:21.681408+0000","last_unstale":"2024-08-17T02:27:22.689010+0000","last_undegraded":"2024-08-17T02:27:22.689010+0000","last_fullsized":"2024-08-17T02:27:22.689010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:20:58.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.722390+0000","last_change":"2024-08-17T02:27:22.718925+0000","last_active":"2024-08-17T02:27:22.722390+0000","last_peered":"2024-08-17T02:27:22.722390+0000","last_clean":"2024-08-17T02:27:22.722390+0000","last_became_active":"2024-08-17T02:27:22.718611+0000","last_became_peered":"2024-08-17T02:27:22.718611+0000","last_unstale":"2024-08-17T02:27:22.722390+0000","last_undegraded":"2024-08-17T02:27:22.722390+0000","last_fullsized":"2024-08-17T02:27:22.722390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:38.536122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710005+0000","last_change":"2024-08-17T02:27:21.680603+0000","last_active":"2024-08-17T02:27:22.710005+0000","last_peered":"2024-08-17T02:27:22.710005+0000","last_clean":"2024-08-17T02:27:22.710005+0000","last_became_active":"2024-08-17T02:27:21.680266+0000","last_became_peered":"2024-08-17T02:27:21.680266+0000","last_unstale":"2024-08-17T02:27:22.710005+0000","last_undegraded":"2024-08-17T02:27:22.710005+0000","last_fullsized":"2024-08-17T02:27:22.710005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:11.110175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706471+0000","last_change":"2024-08-17T02:27:22.701991+0000","last_active":"2024-08-17T02:27:22.706471+0000","last_peered":"2024-08-17T02:27:22.706471+0000","last_clean":"2024-08-17T02:27:22.706471+0000","last_became_active":"2024-08-17T02:27:22.701697+0000","last_became_peered":"2024-08-17T02:27:22.701697+0000","last_unstale":"2024-08-17T02:27:22.706471+0000","last_undegraded":"2024-08-17T02:27:22.706471+0000","last_fullsized":"2024-08-17T02:27:22.706471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:55.821559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.689440+0000","last_change":"2024-08-17T02:27:21.680806+0000","last_active":"2024-08-17T02:27:22.689440+0000","last_peered":"2024-08-17T02:27:22.689440+0000","last_clean":"2024-08-17T02:27:22.689440+0000","last_became_active":"2024-08-17T02:27:21.680436+0000","last_became_peered":"2024-08-17T02:27:21.680436+0000","last_unstale":"2024-08-17T02:27:22.689440+0000","last_undegraded":"2024-08-17T02:27:22.689440+0000","last_fullsized":"2024-08-17T02:27:22.689440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:54.813140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.712702+0000","last_change":"2024-08-17T02:27:22.708669+0000","last_active":"2024-08-17T02:27:22.712702+0000","last_peered":"2024-08-17T02:27:22.712702+0000","last_clean":"2024-08-17T02:27:22.712702+0000","last_became_active":"2024-08-17T02:27:22.708410+0000","last_became_peered":"2024-08-17T02:27:22.708410+0000","last_unstale":"2024-08-17T02:27:22.712702+0000","last_undegraded":"2024-08-17T02:27:22.712702+0000","last_fullsized":"2024-08-17T02:27:22.712702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:41.242530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:23.687372+0000","last_change":"2024-08-17T02:27:21.687483+0000","last_active":"2024-08-17T02:27:23.687372+0000","last_peered":"2024-08-17T02:27:23.687372+0000","last_clean":"2024-08-17T02:27:23.687372+0000","last_became_active":"2024-08-17T02:27:21.687178+0000","last_became_peered":"2024-08-17T02:27:21.687178+0000","last_unstale":"2024-08-17T02:27:23.687372+0000","last_undegraded":"2024-08-17T02:27:23.687372+0000","last_fullsized":"2024-08-17T02:27:23.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:03.027938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719763+0000","last_change":"2024-08-17T02:27:22.712440+0000","last_active":"2024-08-17T02:27:22.719763+0000","last_peered":"2024-08-17T02:27:22.719763+0000","last_clean":"2024-08-17T02:27:22.719763+0000","last_became_active":"2024-08-17T02:27:22.709883+0000","last_became_peered":"2024-08-17T02:27:22.709883+0000","last_unstale":"2024-08-17T02:27:22.719763+0000","last_undegraded":"2024-08-17T02:27:22.719763+0000","last_fullsized":"2024-08-17T02:27:22.719763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:10.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.715159+0000","last_change":"2024-08-17T02:27:21.684633+0000","last_active":"2024-08-17T02:27:22.715159+0000","last_peered":"2024-08-17T02:27:22.715159+0000","last_clean":"2024-08-17T02:27:22.715159+0000","last_became_active":"2024-08-17T02:27:21.684363+0000","last_became_peered":"2024-08-17T02:27:21.684363+0000","last_unstale":"2024-08-17T02:27:22.715159+0000","last_undegraded":"2024-08-17T02:27:22.715159+0000","last_fullsized":"2024-08-17T02:27:22.715159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:28.025035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719493+0000","last_change":"2024-08-17T02:27:22.712731+0000","last_active":"2024-08-17T02:27:22.719493+0000","last_peered":"2024-08-17T02:27:22.719493+0000","last_clean":"2024-08-17T02:27:22.719493+0000","last_became_active":"2024-08-17T02:27:22.712439+0000","last_became_peered":"2024-08-17T02:27:22.712439+0000","last_unstale":"2024-08-17T02:27:22.719493+0000","last_undegraded":"2024-08-17T02:27:22.719493+0000","last_fullsized":"2024-08-17T02:27:22.719493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:11.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.694453+0000","last_change":"2024-08-17T02:27:21.683181+0000","last_active":"2024-08-17T02:27:22.694453+0000","last_peered":"2024-08-17T02:27:22.694453+0000","last_clean":"2024-08-17T02:27:22.694453+0000","last_became_active":"2024-08-17T02:27:21.682819+0000","last_became_peered":"2024-08-17T02:27:21.682819+0000","last_unstale":"2024-08-17T02:27:22.694453+0000","last_undegraded":"2024-08-17T02:27:22.694453+0000","last_fullsized":"2024-08-17T02:27:22.694453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:38.047941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710652+0000","last_change":"2024-08-17T02:27:22.708585+0000","last_active":"2024-08-17T02:27:22.710652+0000","last_peered":"2024-08-17T02:27:22.710652+0000","last_clean":"2024-08-17T02:27:22.710652+0000","last_became_active":"2024-08-17T02:27:22.708311+0000","last_became_peered":"2024-08-17T02:27:22.708311+0000","last_unstale":"2024-08-17T02:27:22.710652+0000","last_undegraded":"2024-08-17T02:27:22.710652+0000","last_fullsized":"2024-08-17T02:27:22.710652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:09.513436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.700112+0000","last_change":"2024-08-17T02:27:21.680475+0000","last_active":"2024-08-17T02:27:22.700112+0000","last_peered":"2024-08-17T02:27:22.700112+0000","last_clean":"2024-08-17T02:27:22.700112+0000","last_became_active":"2024-08-17T02:27:21.680155+0000","last_became_peered":"2024-08-17T02:27:21.680155+0000","last_unstale":"2024-08-17T02:27:22.700112+0000","last_undegraded":"2024-08-17T02:27:22.700112+0000","last_fullsized":"2024-08-17T02:27:22.700112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:53.329468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719660+0000","last_change":"2024-08-17T02:27:22.714582+0000","last_active":"2024-08-17T02:27:22.719660+0000","last_peered":"2024-08-17T02:27:22.719660+0000","last_clean":"2024-08-17T02:27:22.719660+0000","last_became_active":"2024-08-17T02:27:22.713772+0000","last_became_peered":"2024-08-17T02:27:22.713772+0000","last_unstale":"2024-08-17T02:27:22.719660+0000","last_undegraded":"2024-08-17T02:27:22.719660+0000","last_fullsized":"2024-08-17T02:27:22.719660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:41:45.892893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.695233+0000","last_change":"2024-08-17T02:27:21.676299+0000","last_active":"2024-08-17T02:27:22.695233+0000","last_peered":"2024-08-17T02:27:22.695233+0000","last_clean":"2024-08-17T02:27:22.695233+0000","last_became_active":"2024-08-17T02:27:21.676010+0000","last_became_peered":"2024-08-17T02:27:21.676010+0000","last_unstale":"2024-08-17T02:27:22.695233+0000","last_undegraded":"2024-08-17T02:27:22.695233+0000","last_fullsized":"2024-08-17T02:27:22.695233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:22.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.706737+0000","last_change":"2024-08-17T02:27:22.701911+0000","last_active":"2024-08-17T02:27:22.706737+0000","last_peered":"2024-08-17T02:27:22.706737+0000","last_clean":"2024-08-17T02:27:22.706737+0000","last_became_active":"2024-08-17T02:27:22.701476+0000","last_became_peered":"2024-08-17T02:27:22.701476+0000","last_unstale":"2024-08-17T02:27:22.706737+0000","last_undegraded":"2024-08-17T02:27:22.706737+0000","last_fullsized":"2024-08-17T02:27:22.706737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:58:29.033454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710030+0000","last_change":"2024-08-17T02:27:21.678821+0000","last_active":"2024-08-17T02:27:22.710030+0000","last_peered":"2024-08-17T02:27:22.710030+0000","last_clean":"2024-08-17T02:27:22.710030+0000","last_became_active":"2024-08-17T02:27:21.678526+0000","last_became_peered":"2024-08-17T02:27:21.678526+0000","last_unstale":"2024-08-17T02:27:22.710030+0000","last_undegraded":"2024-08-17T02:27:22.710030+0000","last_fullsized":"2024-08-17T02:27:22.710030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:08.424907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.707059+0000","last_change":"2024-08-17T02:27:22.703460+0000","last_active":"2024-08-17T02:27:22.707059+0000","last_peered":"2024-08-17T02:27:22.707059+0000","last_clean":"2024-08-17T02:27:22.707059+0000","last_became_active":"2024-08-17T02:27:22.703160+0000","last_became_peered":"2024-08-17T02:27:22.703160+0000","last_unstale":"2024-08-17T02:27:22.707059+0000","last_undegraded":"2024-08-17T02:27:22.707059+0000","last_fullsized":"2024-08-17T02:27:22.707059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:06.070316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710345+0000","last_change":"2024-08-17T02:27:22.707465+0000","last_active":"2024-08-17T02:27:22.710345+0000","last_peered":"2024-08-17T02:27:22.710345+0000","last_clean":"2024-08-17T02:27:22.710345+0000","last_became_active":"2024-08-17T02:27:22.707187+0000","last_became_peered":"2024-08-17T02:27:22.707187+0000","last_unstale":"2024-08-17T02:27:22.710345+0000","last_undegraded":"2024-08-17T02:27:22.710345+0000","last_fullsized":"2024-08-17T02:27:22.710345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:54.375406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.710322+0000","last_change":"2024-08-17T02:27:21.684023+0000","last_active":"2024-08-17T02:27:22.710322+0000","last_peered":"2024-08-17T02:27:22.710322+0000","last_clean":"2024-08-17T02:27:22.710322+0000","last_became_active":"2024-08-17T02:27:21.683523+0000","last_became_peered":"2024-08-17T02:27:21.683523+0000","last_unstale":"2024-08-17T02:27:22.710322+0000","last_undegraded":"2024-08-17T02:27:22.710322+0000","last_fullsized":"2024-08-17T02:27:22.710322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:01.853992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.717622+0000","last_change":"2024-08-17T02:27:22.715898+0000","last_active":"2024-08-17T02:27:22.717622+0000","last_peered":"2024-08-17T02:27:22.717622+0000","last_clean":"2024-08-17T02:27:22.717622+0000","last_became_active":"2024-08-17T02:27:22.715593+0000","last_became_peered":"2024-08-17T02:27:22.715593+0000","last_unstale":"2024-08-17T02:27:22.717622+0000","last_undegraded":"2024-08-17T02:27:22.717622+0000","last_fullsized":"2024-08-17T02:27:22.717622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:07.864704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.714250+0000","last_change":"2024-08-17T02:27:21.679701+0000","last_active":"2024-08-17T02:27:22.714250+0000","last_peered":"2024-08-17T02:27:22.714250+0000","last_clean":"2024-08-17T02:27:22.714250+0000","last_became_active":"2024-08-17T02:27:21.679276+0000","last_became_peered":"2024-08-17T02:27:21.679276+0000","last_unstale":"2024-08-17T02:27:22.714250+0000","last_undegraded":"2024-08-17T02:27:22.714250+0000","last_fullsized":"2024-08-17T02:27:22.714250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:06.856285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.719485+0000","last_change":"2024-08-17T02:27:22.715682+0000","last_active":"2024-08-17T02:27:22.719485+0000","last_peered":"2024-08-17T02:27:22.719485+0000","last_clean":"2024-08-17T02:27:22.719485+0000","last_became_active":"2024-08-17T02:27:22.714110+0000","last_became_peered":"2024-08-17T02:27:22.714110+0000","last_unstale":"2024-08-17T02:27:22.719485+0000","last_undegraded":"2024-08-17T02:27:22.719485+0000","last_fullsized":"2024-08-17T02:27:22.719485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:14.154747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718562+0000","last_change":"2024-08-17T02:27:21.676227+0000","last_active":"2024-08-17T02:27:22.718562+0000","last_peered":"2024-08-17T02:27:22.718562+0000","last_clean":"2024-08-17T02:27:22.718562+0000","last_became_active":"2024-08-17T02:27:21.675914+0000","last_became_peered":"2024-08-17T02:27:21.675914+0000","last_unstale":"2024-08-17T02:27:22.718562+0000","last_undegraded":"2024-08-17T02:27:22.718562+0000","last_fullsized":"2024-08-17T02:27:22.718562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:44.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718657+0000","last_change":"2024-08-17T02:27:22.713584+0000","last_active":"2024-08-17T02:27:22.718657+0000","last_peered":"2024-08-17T02:27:22.718657+0000","last_clean":"2024-08-17T02:27:22.718657+0000","last_became_active":"2024-08-17T02:27:22.710898+0000","last_became_peered":"2024-08-17T02:27:22.710898+0000","last_unstale":"2024-08-17T02:27:22.718657+0000","last_undegraded":"2024-08-17T02:27:22.718657+0000","last_fullsized":"2024-08-17T02:27:22.718657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:21.651045+0000","last_clean_scrub_stamp":"2024-08-17T02:27:21.651045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:08.300614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:22.718550+0000","last_change":"2024-08-17T02:27:21.683370+0000","last_active":"2024-08-17T02:27:22.718550+0000","last_peered":"2024-08-17T02:27:22.718550+0000","last_clean":"2024-08-17T02:27:22.718550+0000","last_became_active":"2024-08-17T02:27:21.683066+0000","last_became_peered":"2024-08-17T02:27:21.683066+0000","last_unstale":"2024-08-17T02:27:22.718550+0000","last_undegraded":"2024-08-17T02:27:22.718550+0000","last_fullsized":"2024-08-17T02:27:22.718550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.642627+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.642627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:38.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":73913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":663238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":76001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":811008,"data_stored":664227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:32.852 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:27:32.852 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:27:32.852 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:27:32.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:27:32.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 Processor -- start 2024-08-17T02:27:32.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- start start 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff16c0cb560 0x7ff16c161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c0cbaa0 con 0x7ff16c0b14a0 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c157630 con 0x7ff16c154900 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16c068790 con 0x7ff16c0cb560 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff171d33700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff16c0cb560 0x7ff16c161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff170d31700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff16c0b14a0 0x7ff16c0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:49410/0 (socket says 172.21.15.155:49410) 2024-08-17T02:27:32.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff170d31700 1 -- 172.21.15.155:0/4175465983 learned_addr learned my addr 172.21.15.155:0/4175465983 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:32.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff171d33700 1 -- 172.21.15.155:0/4175465983 >> v1:172.21.15.189:6789/0 conn(0x7ff16c154900 legacy=0x7ff16c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff171d33700 1 -- 172.21.15.155:0/4175465983 >> v1:172.21.15.155:6789/0 conn(0x7ff16c0b14a0 legacy=0x7ff16c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff171d33700 1 -- 172.21.15.155:0/4175465983 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c157910 con 0x7ff16c0cb560 2024-08-17T02:27:32.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff171d33700 1 --2- 172.21.15.155:0/4175465983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c161ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff164009e60 tx=0x7ff164009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e845ae5ecc85637 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff163fff700 1 -- 172.21.15.155:0/4175465983 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400e070 con 0x7ff16c0cb560 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff163fff700 1 -- 172.21.15.155:0/4175465983 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400bbf0 con 0x7ff16c0cb560 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff163fff700 1 -- 172.21.15.155:0/4175465983 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164012430 con 0x7ff16c0cb560 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- 172.21.15.155:0/4175465983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 msgr2=0x7ff16c161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 --2- 172.21.15.155:0/4175465983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c161ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff164009e60 tx=0x7ff164009780 comp rx=0 tx=0).stop 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- 172.21.15.155:0/4175465983 shutdown_connections 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 --2- 172.21.15.155:0/4175465983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c161ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.948+0000 7ff172534700 1 -- 172.21.15.155:0/4175465983 >> 172.21.15.155:0/4175465983 conn(0x7ff16c0678d0 msgr2=0x7ff16c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- 172.21.15.155:0/4175465983 shutdown_connections 2024-08-17T02:27:32.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- 172.21.15.155:0/4175465983 wait complete. 2024-08-17T02:27:32.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 Processor -- start 2024-08-17T02:27:32.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- start start 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff16c0b14a0 0x7ff16c0a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff16c154900 0x7ff16c141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0a6580 con 0x7ff16c0cb560 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0a6820 con 0x7ff16c0b14a0 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff172534700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0a6b00 con 0x7ff16c154900 2024-08-17T02:27:32.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50348/0 (socket says 172.21.15.155:50348) 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 -- 172.21.15.155:0/284112454 learned_addr learned my addr 172.21.15.155:0/284112454 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff171d33700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff16c154900 0x7ff16c141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff171532700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff16c0b14a0 0x7ff16c0a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 -- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff16c154900 msgr2=0x7ff16c141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff16c154900 0x7ff16c141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 -- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff16c0b14a0 msgr2=0x7ff16c0a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff16c0b14a0 0x7ff16c0a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 -- 172.21.15.155:0/284112454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164009a20 con 0x7ff16c0cb560 2024-08-17T02:27:32.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.952+0000 7ff170d31700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c790 tx=0x7ff15c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c005b30 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c005c90 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c0a6de0 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c007300 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c0a9710 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c0643a0 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff15c01b3b0 con 0x7ff16c0cb560 2024-08-17T02:27:32.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff15c07c040 con 0x7ff16c0cb560 2024-08-17T02:27:32.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff171532700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.956+0000 7ff171532700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff168006fd0 tx=0x7ff168008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:32.964+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff15c04c490 con 0x7ff16c0cb560 2024-08-17T02:27:33.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.144+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff16c06f5f0 con 0x7ff16c0cb560 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.144+0000 7ff1617fa700 1 -- 172.21.15.155:0/284112454 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff15c001d60 con 0x7ff16c0cb560 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:33.149 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 msgr2=0x7ff150062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff168006fd0 tx=0x7ff168008040 comp rx=0 tx=0).stop 2024-08-17T02:27:33.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 msgr2=0x7ff16c1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c790 tx=0x7ff15c007f00 comp rx=0 tx=0).stop 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 shutdown_connections 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff16c154900 0x7ff16c141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16c0cb560 0x7ff16c1560d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 --2- 172.21.15.155:0/284112454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff16c0b14a0 0x7ff16c0a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 >> 172.21.15.155:0/284112454 conn(0x7ff16c0678d0 msgr2=0x7ff16c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 shutdown_connections 2024-08-17T02:27:33.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.148+0000 7ff172534700 1 -- 172.21.15.155:0/284112454 wait complete. 2024-08-17T02:27:33.162 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:27:33.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:33.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 Processor -- start 2024-08-17T02:27:33.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 -- start start 2024-08-17T02:27:33.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d8156c80 0x7f25d8157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25d80b0e20 0x7f25d80b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d806ed00 con 0x7f25d80ad920 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d806df10 con 0x7f25d80b0e20 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25dcdb8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80b17b0 con 0x7f25d8156c80 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25d80b0e20 0x7f25d80b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25d80b0e20 0x7f25d80b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50352/0 (socket says 172.21.15.155:50352) 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 -- 172.21.15.155:0/4109913272 learned_addr learned my addr 172.21.15.155:0/4109913272 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 -- 172.21.15.155:0/4109913272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d8156c80 msgr2=0x7f25d8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 --2- 172.21.15.155:0/4109913272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d8156c80 0x7f25d8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 -- 172.21.15.155:0/4109913272 >> v1:172.21.15.189:6789/0 conn(0x7f25d80ad920 legacy=0x7f25d80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 -- 172.21.15.155:0/4109913272 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80accc0 con 0x7f25d80b0e20 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d6ffd700 1 --2- 172.21.15.155:0/4109913272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d80b0e20 0x7f25d80b1270 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0099b0 tx=0x7f25cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff1cbc7772f745e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.260+0000 7f25d67fc700 1 -- 172.21.15.155:0/4109913272 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00b820 con 0x7f25d80b0e20 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25d67fc700 1 -- 172.21.15.155:0/4109913272 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc00b980 con 0x7f25d80b0e20 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25d67fc700 1 -- 172.21.15.155:0/4109913272 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00bd20 con 0x7f25d80b0e20 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- 172.21.15.155:0/4109913272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d80b0e20 msgr2=0x7f25d80b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/4109913272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d80b0e20 0x7f25d80b1270 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0099b0 tx=0x7f25cc009250 comp rx=0 tx=0).stop 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- 172.21.15.155:0/4109913272 shutdown_connections 2024-08-17T02:27:33.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/4109913272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d80b0e20 0x7f25d80b1270 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/4109913272 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d8156c80 0x7f25d8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- 172.21.15.155:0/4109913272 >> 172.21.15.155:0/4109913272 conn(0x7f25d8067860 msgr2=0x7f25d8067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- 172.21.15.155:0/4109913272 shutdown_connections 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- 172.21.15.155:0/4109913272 wait complete. 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 Processor -- start 2024-08-17T02:27:33.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.264+0000 7f25dcdb8700 1 -- start start 2024-08-17T02:27:33.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 0x7f25d80c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d80b0e20 0x7f25d80a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 0x7f25d80c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80c86b0 con 0x7f25d8156c80 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80aa570 con 0x7f25d80ad920 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80aa850 con 0x7f25d80b0e20 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 0x7f25d80c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 0x7f25d80c1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50354/0 (socket says 172.21.15.155:50354) 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d7fff700 1 -- 172.21.15.155:0/1608730253 learned_addr learned my addr 172.21.15.155:0/1608730253 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 0x7f25d80c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d6ffd700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d80b0e20 0x7f25d80a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 -- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d80b0e20 msgr2=0x7f25d80a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d80b0e20 0x7f25d80a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 -- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 msgr2=0x7f25d80c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 0x7f25d80c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 -- 172.21.15.155:0/1608730253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0094f0 con 0x7f25d80ad920 2024-08-17T02:27:33.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25d77fe700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 0x7f25d80c8170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25c800b5e0 tx=0x7f25c80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800f510 con 0x7f25d80ad920 2024-08-17T02:27:33.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c800f670 con 0x7f25d80ad920 2024-08-17T02:27:33.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80aab30 con 0x7f25d80ad920 2024-08-17T02:27:33.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800fa30 con 0x7f25d80ad920 2024-08-17T02:27:33.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d80ab0f0 con 0x7f25d80ad920 2024-08-17T02:27:33.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.268+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d80b12a0 con 0x7f25d80ad920 2024-08-17T02:27:33.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.272+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f25c801a400 con 0x7f25d80ad920 2024-08-17T02:27:33.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.272+0000 7f25bf7fe700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 0x7f25c4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.272+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25c807ca70 con 0x7f25d80ad920 2024-08-17T02:27:33.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.272+0000 7f25d6ffd700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 0x7f25c4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.272+0000 7f25d6ffd700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 0x7f25c4062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0099b0 tx=0x7f25cc016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.284+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f25c804cf40 con 0x7f25d80ad920 2024-08-17T02:27:33.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.436+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25d80b12a0 con 0x7f25d80ad920 2024-08-17T02:27:33.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25bf7fe700 1 -- 172.21.15.155:0/1608730253 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f25d80b12a0 con 0x7f25d80ad920 2024-08-17T02:27:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:33.442 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 msgr2=0x7f25c4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 0x7f25c4062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0099b0 tx=0x7f25cc016000 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 msgr2=0x7f25d80c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 0x7f25d80c8170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25c800b5e0 tx=0x7f25c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 shutdown_connections 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f25c4060860 0x7f25c4062d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25d8156c80 0x7f25d80c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f25d80b0e20 0x7f25d80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 --2- 172.21.15.155:0/1608730253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d80ad920 0x7f25d80c8170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 >> 172.21.15.155:0/1608730253 conn(0x7f25d8067860 msgr2=0x7f25d80ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 shutdown_connections 2024-08-17T02:27:33.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.440+0000 7f25dcdb8700 1 -- 172.21.15.155:0/1608730253 wait complete. 2024-08-17T02:27:33.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:33.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:33.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 Processor -- start 2024-08-17T02:27:33.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 -- start start 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 0x7f7fcc15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0cc350 con 0x7f7fcc0b0390 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0ca760 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcbfff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cd3f0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43344/0 (socket says 172.21.15.155:43344) 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 -- 172.21.15.155:0/3162769086 learned_addr learned my addr 172.21.15.155:0/3162769086 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fca7fc700 1 --2- 172.21.15.155:0/3162769086 >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 0x7f7fcc15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 -- 172.21.15.155:0/3162769086 >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 msgr2=0x7f7fcc15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 --2- 172.21.15.155:0/3162769086 >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 0x7f7fcc15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 -- 172.21.15.155:0/3162769086 >> v1:172.21.15.189:6789/0 conn(0x7f7fcc0b0390 legacy=0x7f7fcc15cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 -- 172.21.15.155:0/3162769086 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0cc630 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fca7fc700 1 --2- 172.21.15.155:0/3162769086 >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 0x7f7fcc15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fcb7fe700 1 --2- 172.21.15.155:0/3162769086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065680 tx=0x7f7fc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a085b89ed4232b29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.560+0000 7f7fc9ffb700 1 -- 172.21.15.155:0/3162769086 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc400e070 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fc9ffb700 1 -- 172.21.15.155:0/3162769086 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc400ba50 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fc9ffb700 1 -- 172.21.15.155:0/3162769086 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc40092e0 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- 172.21.15.155:0/3162769086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc15d9f0 msgr2=0x7f7fcc0c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/3162769086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065680 tx=0x7f7fc4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:33.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- 172.21.15.155:0/3162769086 shutdown_connections 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/3162769086 >> v2:172.21.15.189:3300/0 conn(0x7f7fcc0cbcc0 0x7f7fcc15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/3162769086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc0c2c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- 172.21.15.155:0/3162769086 >> 172.21.15.155:0/3162769086 conn(0x7f7fcc0cdee0 msgr2=0x7f7fcc0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- 172.21.15.155:0/3162769086 shutdown_connections 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- 172.21.15.155:0/3162769086 wait complete. 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 Processor -- start 2024-08-17T02:27:33.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.564+0000 7f7fcbfff700 1 -- start start 2024-08-17T02:27:33.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7fcc0b0390 0x7f7fcc151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b0c80 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b1a70 con 0x7f7fcc15d9f0 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b0e60 con 0x7f7fcc0b0390 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43360/0 (socket says 172.21.15.155:43360) 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 -- 172.21.15.155:0/2026928670 learned_addr learned my addr 172.21.15.155:0/2026928670 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcaffd700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7fcc0b0390 0x7f7fcc151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcb7fe700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 -- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7fcc0b0390 msgr2=0x7f7fcc151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7fcc0b0390 0x7f7fcc151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 -- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 msgr2=0x7f7fcc153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 -- 172.21.15.155:0/2026928670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc4009ae0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcb7fe700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fca7fc700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400e8d0 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4013410 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4013570 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0b1140 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4013910 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc0b1700 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.568+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc157de0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.572+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7fb4013d00 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.572+0000 7f7fc2ffd700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 0x7f7fac062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.572+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fb407c870 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.572+0000 7f7fcaffd700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 0x7f7fac062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.572+0000 7f7fcaffd700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 0x7f7fac062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc003a80 tx=0x7f7fbc007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.580+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7fb404ccc0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.740+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fcc0638f0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.740+0000 7f7fc2ffd700 1 -- 172.21.15.155:0/2026928670 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fb40200a0 con 0x7f7fcc0cbcc0 2024-08-17T02:27:33.744 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:33.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 msgr2=0x7f7fac062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 0x7f7fac062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc003a80 tx=0x7f7fbc007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 msgr2=0x7f7fcc156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400e8d0 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 shutdown_connections 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7fac060890 0x7f7fac062d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fcc15d9f0 0x7f7fcc153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fcc0cbcc0 0x7f7fcc156910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 --2- 172.21.15.155:0/2026928670 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7fcc0b0390 0x7f7fcc151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 >> 172.21.15.155:0/2026928670 conn(0x7f7fcc0cdee0 msgr2=0x7f7fcc0c2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 shutdown_connections 2024-08-17T02:27:33.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.744+0000 7f7fcbfff700 1 -- 172.21.15.155:0/2026928670 wait complete. 2024-08-17T02:27:33.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:33.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 Processor -- start 2024-08-17T02:27:33.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 -- start start 2024-08-17T02:27:33.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2bf41514d0 0x7f2bf406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf40b14a0 0x7f2bf4157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf406e010 con 0x7f2bf41574f0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf406efa0 con 0x7f2bf40b14a0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf89e3700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf4157fb0 con 0x7f2bf41514d0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf40b14a0 0x7f2bf4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf40b14a0 0x7f2bf4157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43376/0 (socket says 172.21.15.155:43376) 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 -- 172.21.15.155:0/1207125040 learned_addr learned my addr 172.21.15.155:0/1207125040 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf37fe700 1 --2- 172.21.15.155:0/1207125040 >> v2:172.21.15.189:3300/0 conn(0x7f2bf41514d0 0x7f2bf406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 -- 172.21.15.155:0/1207125040 >> v2:172.21.15.189:3300/0 conn(0x7f2bf41514d0 msgr2=0x7f2bf406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 --2- 172.21.15.155:0/1207125040 >> v2:172.21.15.189:3300/0 conn(0x7f2bf41514d0 0x7f2bf406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 -- 172.21.15.155:0/1207125040 >> v1:172.21.15.189:6789/0 conn(0x7f2bf41574f0 legacy=0x7f2bf40b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.872+0000 7f2bf3fff700 1 -- 172.21.15.155:0/1207125040 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4158290 con 0x7f2bf40b14a0 2024-08-17T02:27:33.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf3fff700 1 --2- 172.21.15.155:0/1207125040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4157990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bf405f080 tx=0x7f2bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecd2998a3991b8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf27fc700 1 -- 172.21.15.155:0/1207125040 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00e070 con 0x7f2bf40b14a0 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf27fc700 1 -- 172.21.15.155:0/1207125040 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00ba50 con 0x7f2bf40b14a0 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf27fc700 1 -- 172.21.15.155:0/1207125040 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0092e0 con 0x7f2bf40b14a0 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 -- 172.21.15.155:0/1207125040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf40b14a0 msgr2=0x7f2bf4157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/1207125040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4157990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bf405f080 tx=0x7f2bec009840 comp rx=0 tx=0).stop 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 -- 172.21.15.155:0/1207125040 shutdown_connections 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/1207125040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4157990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/1207125040 >> v2:172.21.15.189:3300/0 conn(0x7f2bf41514d0 0x7f2bf406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 -- 172.21.15.155:0/1207125040 >> 172.21.15.155:0/1207125040 conn(0x7f2bf40678a0 msgr2=0x7f2bf4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 -- 172.21.15.155:0/1207125040 shutdown_connections 2024-08-17T02:27:33.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.876+0000 7f2bf89e3700 1 -- 172.21.15.155:0/1207125040 wait complete. 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 Processor -- start 2024-08-17T02:27:33.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- start start 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4166030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf41514d0 0x7f2bf41496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40ac4e0 con 0x7f2bf41574f0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40ac740 con 0x7f2bf40b14a0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40aca20 con 0x7f2bf41514d0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43384/0 (socket says 172.21.15.155:43384) 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 -- 172.21.15.155:0/372701283 learned_addr learned my addr 172.21.15.155:0/372701283 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf2ffd700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf41514d0 0x7f2bf41496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf37fe700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 -- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf41514d0 msgr2=0x7f2bf41496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf41514d0 0x7f2bf41496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 -- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 msgr2=0x7f2bf4166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 -- 172.21.15.155:0/372701283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009ae0 con 0x7f2bf41574f0 2024-08-17T02:27:33.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf37fe700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf3fff700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2bec012000 tx=0x7f2bec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00be60 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec008dd0 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0266b0 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf40acd00 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.880+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf40ad2c0 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf40ad4b0 con 0x7f2bf41574f0 2024-08-17T02:27:33.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2bec003040 con 0x7f2bf41574f0 2024-08-17T02:27:33.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2beb7fe700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 0x7f2bd8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2bec07eb40 con 0x7f2bf41574f0 2024-08-17T02:27:33.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2bf37fe700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 0x7f2bd8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.884+0000 7f2bf37fe700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 0x7f2bd8062d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:33.888+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2bf40ad4b0 con 0x7f2bf41574f0 2024-08-17T02:27:34.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.056+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bf40ad4b0 con 0x7f2bf41574f0 2024-08-17T02:27:34.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2beb7fe700 1 -- 172.21.15.155:0/372701283 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bf40ad4b0 con 0x7f2bf41574f0 2024-08-17T02:27:34.062 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:34.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 msgr2=0x7f2bd8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 0x7f2bd8062d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 msgr2=0x7f2bf4149c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2bec012000 tx=0x7f2bec018000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 shutdown_connections 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2bd8060890 0x7f2bd8062d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf41574f0 0x7f2bf4149c30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf41514d0 0x7f2bf41496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 --2- 172.21.15.155:0/372701283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bf40b14a0 0x7f2bf4166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 >> 172.21.15.155:0/372701283 conn(0x7f2bf40678a0 msgr2=0x7f2bf4155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 shutdown_connections 2024-08-17T02:27:34.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.060+0000 7f2bf89e3700 1 -- 172.21.15.155:0/372701283 wait complete. 2024-08-17T02:27:34.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:34.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 Processor -- start 2024-08-17T02:27:34.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 -- start start 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2410067400 0x7f24101593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100cf670 con 0x7f24100cfb00 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100cea60 con 0x7f2410067030 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f2414dbb700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2410159910 con 0x7f2410067400 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f24100cfb00 0x7f2410158cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42724/0 (socket says 172.21.15.155:42724) 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240effd700 1 -- 172.21.15.155:0/3927421449 learned_addr learned my addr 172.21.15.155:0/3927421449 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240ffff700 1 --2- 172.21.15.155:0/3927421449 >> v2:172.21.15.189:3300/0 conn(0x7f2410067400 0x7f24101593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598647138 0 0) 0x7f24100cf670 con 0x7f24100cfb00 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f8003570 con 0x7f24100cfb00 2024-08-17T02:27:34.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728468568 0 0) 0x7f23f8003570 con 0x7f24100cfb00 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 >> v2:172.21.15.189:3300/0 conn(0x7f2410067400 msgr2=0x7f24101593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 --2- 172.21.15.155:0/3927421449 >> v2:172.21.15.189:3300/0 conn(0x7f2410067400 0x7f24101593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 >> v1:172.21.15.189:6789/0 conn(0x7f2410067030 legacy=0x7f24100cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100ced40 con 0x7f24100cfb00 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f2400001470 con 0x7f24100cfb00 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.180+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 >> v1:172.21.15.155:6789/0 conn(0x7f24100cfb00 legacy=0x7f2410158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 0x7f23f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f23f8004810 0x7f23f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f80051c0 0x7f23f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800c0a0 con 0x7f23f8003a60 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800c210 con 0x7f23f80051c0 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800c3d0 con 0x7f23f8004810 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 0x7f23f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240ffff700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f80051c0 0x7f23f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240effd700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f23f8004810 0x7f23f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 -- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f23f8004810 msgr2=0x7f23f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f23f8004810 0x7f23f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 -- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f80051c0 msgr2=0x7f23f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f80051c0 0x7f23f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 -- 172.21.15.155:0/3927421449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8003570 con 0x7f23f8003a60 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240ffff700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f80051c0 0x7f23f800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240ffff700 1 -- 172.21.15.155:0/3927421449 reap_dead start 2024-08-17T02:27:34.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240f7fe700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 0x7f23f8003e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f24040018b0 tx=0x7f2404007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea908a77c4dfddc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404012420 con 0x7f23f8003a60 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24040125a0 con 0x7f23f8003a60 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f240e7fc700 1 -- 172.21.15.155:0/3927421449 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404012960 con 0x7f23f8003a60 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 -- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 msgr2=0x7f23f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 0x7f23f8003e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f24040018b0 tx=0x7f2404007d30 comp rx=0 tx=0).stop 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 -- 172.21.15.155:0/3927421449 shutdown_connections 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 --2- 172.21.15.155:0/3927421449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23f8003a60 0x7f23f8003e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 -- 172.21.15.155:0/3927421449 >> 172.21.15.155:0/3927421449 conn(0x7f24100d0b50 msgr2=0x7f24100ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 -- 172.21.15.155:0/3927421449 shutdown_connections 2024-08-17T02:27:34.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.184+0000 7f2414dbb700 1 -- 172.21.15.155:0/3927421449 wait complete. 2024-08-17T02:27:34.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 Processor -- start 2024-08-17T02:27:34.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- start start 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 0x7f2410151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24101490b0 0x7f2410151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410169d80 con 0x7f2410169830 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241016a060 con 0x7f23f8003a60 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241016a340 con 0x7f24101490b0 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240effd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24101490b0 0x7f2410151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43398/0 (socket says 172.21.15.155:43398) 2024-08-17T02:27:34.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 -- 172.21.15.155:0/2888167877 learned_addr learned my addr 172.21.15.155:0/2888167877 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240f7fe700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 0x7f2410151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 -- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24101490b0 msgr2=0x7f2410151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24101490b0 0x7f2410151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 -- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 msgr2=0x7f2410151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 0x7f2410151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 -- 172.21.15.155:0/2888167877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241016a620 con 0x7f2410169830 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240f7fe700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 0x7f2410151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f240ffff700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2410088bf0 tx=0x7f240800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800e040 con 0x7f2410169830 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800f040 con 0x7f2410169830 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241014f0a0 con 0x7f2410169830 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800fe60 con 0x7f2410169830 2024-08-17T02:27:34.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.188+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2410154eb0 con 0x7f2410169830 2024-08-17T02:27:34.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2408015640 con 0x7f2410169830 2024-08-17T02:27:34.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24100638f0 con 0x7f2410169830 2024-08-17T02:27:34.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f23f77fe700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 0x7f23fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f240807cc50 con 0x7f2410169830 2024-08-17T02:27:34.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f240f7fe700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 0x7f23fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.192+0000 7f240f7fe700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 0x7f23fc062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2404012ad0 tx=0x7f2404015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.200+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f240804d0a0 con 0x7f2410169830 2024-08-17T02:27:34.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.368+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2410154b40 con 0x7f2410169830 2024-08-17T02:27:34.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.368+0000 7f23f77fe700 1 -- 172.21.15.155:0/2888167877 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f240801e020 con 0x7f2410169830 2024-08-17T02:27:34.372 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:34.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 msgr2=0x7f23fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 0x7f23fc062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2404012ad0 tx=0x7f2404015000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 msgr2=0x7f241016ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2410088bf0 tx=0x7f240800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 shutdown_connections 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f23fc060860 0x7f23fc062d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2410169830 0x7f241016ce30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24101490b0 0x7f2410151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 --2- 172.21.15.155:0/2888167877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23f8003a60 0x7f2410151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 >> 172.21.15.155:0/2888167877 conn(0x7f24100d0b50 msgr2=0x7f24100b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 shutdown_connections 2024-08-17T02:27:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.372+0000 7f2414dbb700 1 -- 172.21.15.155:0/2888167877 wait complete. 2024-08-17T02:27:34.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:34.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 Processor -- start 2024-08-17T02:27:34.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 -- start start 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f273c142860 0x7f273c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0b2220 con 0x7f273c142c30 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c159790 con 0x7f273c142860 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f2740de8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0b2500 con 0x7f273c06f2d0 2024-08-17T02:27:34.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f273affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f273c142c30 0x7f273c0b0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42728/0 (socket says 172.21.15.155:42728) 2024-08-17T02:27:34.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.488+0000 7f273affd700 1 -- 172.21.15.155:0/1837520632 learned_addr learned my addr 172.21.15.155:0/1837520632 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273b7fe700 1 --2- 172.21.15.155:0/1837520632 >> v2:172.21.15.189:3300/0 conn(0x7f273c142860 0x7f273c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 --2- 172.21.15.155:0/1837520632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273a7fc700 1 -- 172.21.15.155:0/1837520632 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130832740 0 0) 0x7f273c0b2220 con 0x7f273c142c30 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273a7fc700 1 -- 172.21.15.155:0/1837520632 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c003570 con 0x7f273c142c30 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 -- 172.21.15.155:0/1837520632 >> v2:172.21.15.189:3300/0 conn(0x7f273c142860 msgr2=0x7f273c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 --2- 172.21.15.155:0/1837520632 >> v2:172.21.15.189:3300/0 conn(0x7f273c142860 0x7f273c06e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 -- 172.21.15.155:0/1837520632 >> v1:172.21.15.155:6789/0 conn(0x7f273c142c30 legacy=0x7f273c0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 -- 172.21.15.155:0/1837520632 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0b27e0 con 0x7f273c06f2d0 2024-08-17T02:27:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273bfff700 1 --2- 172.21.15.155:0/1837520632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c06ec60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2734009e60 tx=0x7f2734009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e0fe0ecd0d7e84 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273a7fc700 1 -- 172.21.15.155:0/1837520632 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400e070 con 0x7f273c06f2d0 2024-08-17T02:27:34.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273a7fc700 1 -- 172.21.15.155:0/1837520632 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273400bab0 con 0x7f273c06f2d0 2024-08-17T02:27:34.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f273a7fc700 1 -- 172.21.15.155:0/1837520632 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400be30 con 0x7f273c06f2d0 2024-08-17T02:27:34.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 -- 172.21.15.155:0/1837520632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 msgr2=0x7f273c06ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 --2- 172.21.15.155:0/1837520632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c06ec60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2734009e60 tx=0x7f2734009780 comp rx=0 tx=0).stop 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 -- 172.21.15.155:0/1837520632 shutdown_connections 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 --2- 172.21.15.155:0/1837520632 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c06ec60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 --2- 172.21.15.155:0/1837520632 >> v2:172.21.15.189:3300/0 conn(0x7f273c142860 0x7f273c06e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 -- 172.21.15.155:0/1837520632 >> 172.21.15.155:0/1837520632 conn(0x7f273c0ca2b0 msgr2=0x7f273c06e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 -- 172.21.15.155:0/1837520632 shutdown_connections 2024-08-17T02:27:34.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.492+0000 7f2740de8700 1 -- 172.21.15.155:0/1837520632 wait complete. 2024-08-17T02:27:34.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.496+0000 7f2740de8700 1 Processor -- start 2024-08-17T02:27:34.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.496+0000 7f2740de8700 1 -- start start 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f273c142c30 0x7f273c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c2f20 con 0x7f273c142860 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c3200 con 0x7f273c142c30 2024-08-17T02:27:34.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c34e0 con 0x7f273c06f2d0 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43410/0 (socket says 172.21.15.155:43410) 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 -- 172.21.15.155:0/4065495427 learned_addr learned my addr 172.21.15.155:0/4065495427 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273bfff700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f273c142c30 0x7f273c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273b7fe700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 -- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 msgr2=0x7f273c0c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c0c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 -- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f273c142c30 msgr2=0x7f273c0abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f273c142c30 0x7f273c0abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 -- 172.21.15.155:0/4065495427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009a20 con 0x7f273c142860 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f273affd700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27240011e0 tx=0x7f2724007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724005b30 con 0x7f273c142860 2024-08-17T02:27:34.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724005c90 con 0x7f273c142860 2024-08-17T02:27:34.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0c4b10 con 0x7f273c142860 2024-08-17T02:27:34.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724007320 con 0x7f273c142860 2024-08-17T02:27:34.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0c7a70 con 0x7f273c142860 2024-08-17T02:27:34.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0c4970 con 0x7f273c142860 2024-08-17T02:27:34.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2724007690 con 0x7f273c142860 2024-08-17T02:27:34.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.500+0000 7f27337fe700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.504+0000 7f273b7fe700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.504+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f272407bf60 con 0x7f273c142860 2024-08-17T02:27:34.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.504+0000 7f273b7fe700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 0x7f2720062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f272c009db0 tx=0x7f272c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.504+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f273c0c4970 con 0x7f273c142860 2024-08-17T02:27:34.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.704+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f273c0c4d50 con 0x7f273c142860 2024-08-17T02:27:34.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f27337fe700 1 -- 172.21.15.155:0/4065495427 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f273c0c4d50 con 0x7f273c142860 2024-08-17T02:27:34.710 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:34.710 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 msgr2=0x7f2720062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 0x7f2720062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f272c009db0 tx=0x7f272c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 msgr2=0x7f273c0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27240011e0 tx=0x7f2724007df0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 shutdown_connections 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2720060860 0x7f2720062d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f273c142c30 0x7f273c0abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f273c142860 0x7f273c0c7530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 --2- 172.21.15.155:0/4065495427 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f273c06f2d0 0x7f273c0c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 >> 172.21.15.155:0/4065495427 conn(0x7f273c0ca2b0 msgr2=0x7f273c06dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 shutdown_connections 2024-08-17T02:27:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.708+0000 7f2740de8700 1 -- 172.21.15.155:0/4065495427 wait complete. 2024-08-17T02:27:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:34.725 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:34.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 Processor -- start 2024-08-17T02:27:34.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 -- start start 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cd80b12d0 0x7f7cd80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd80cbaa0 con 0x7f7cd80cb390 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd8068790 con 0x7f7cd80b12d0 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cddada700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd81583f0 con 0x7f7cd8154900 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cd80b12d0 0x7f7cd80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cd80b12d0 0x7f7cd80cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43420/0 (socket says 172.21.15.155:43420) 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 -- 172.21.15.155:0/822100134 learned_addr learned my addr 172.21.15.155:0/822100134 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cdcad8700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 -- 172.21.15.155:0/822100134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 msgr2=0x7f7cd80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd80b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 -- 172.21.15.155:0/822100134 >> v1:172.21.15.155:6789/0 conn(0x7f7cd80cb390 legacy=0x7f7cd806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 -- 172.21.15.155:0/822100134 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80b1700 con 0x7f7cd80b12d0 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cdcad8700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd7fff700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd80cae50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009f20 tx=0x7f7cc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569911795c33e7f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd77fe700 1 -- 172.21.15.155:0/822100134 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000e070 con 0x7f7cd80b12d0 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd77fe700 1 -- 172.21.15.155:0/822100134 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000ba80 con 0x7f7cd80b12d0 2024-08-17T02:27:34.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.824+0000 7f7cd77fe700 1 -- 172.21.15.155:0/822100134 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00092e0 con 0x7f7cd80b12d0 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- 172.21.15.155:0/822100134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 msgr2=0x7f7cd80cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd80cae50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009f20 tx=0x7f7cc0009840 comp rx=0 tx=0).stop 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- 172.21.15.155:0/822100134 shutdown_connections 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd80cae50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- 172.21.15.155:0/822100134 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- 172.21.15.155:0/822100134 >> 172.21.15.155:0/822100134 conn(0x7f7cd80678d0 msgr2=0x7f7cd8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- 172.21.15.155:0/822100134 shutdown_connections 2024-08-17T02:27:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- 172.21.15.155:0/822100134 wait complete. 2024-08-17T02:27:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 Processor -- start 2024-08-17T02:27:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- start start 2024-08-17T02:27:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd8153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 0x7f7cd80acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8153090 con 0x7f7cd80b12d0 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8152d90 con 0x7f7cd80cb390 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cddada700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8155640 con 0x7f7cd8154900 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cdcad8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd8153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cd7fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 0x7f7cd80acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cdcad8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd8153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43428/0 (socket says 172.21.15.155:43428) 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.828+0000 7f7cdcad8700 1 -- 172.21.15.155:0/105603552 learned_addr learned my addr 172.21.15.155:0/105603552 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:34.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cdd2d9700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 -- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 msgr2=0x7f7cd814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 -- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 msgr2=0x7f7cd8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd8153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 -- 172.21.15.155:0/105603552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009ae0 con 0x7f7cd80cb390 2024-08-17T02:27:34.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd7fff700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 0x7f7cd80acbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0015000 tx=0x7f7cc0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0008a80 con 0x7f7cd80cb390 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd8155920 con 0x7f7cd80cb390 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0008c20 con 0x7f7cd80cb390 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc001c410 con 0x7f7cd80cb390 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd8155c00 con 0x7f7cd80cb390 2024-08-17T02:27:34.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8153240 con 0x7f7cd80cb390 2024-08-17T02:27:34.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.832+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7cc0003040 con 0x7f7cd80cb390 2024-08-17T02:27:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.836+0000 7f7cd4ff9700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 0x7f7cbc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.836+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cc007e4f0 con 0x7f7cd80cb390 2024-08-17T02:27:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.836+0000 7f7cdcad8700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 0x7f7cbc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.836+0000 7f7cdcad8700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 0x7f7cbc062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006fd0 tx=0x7f7cd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:34.844+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7cc004e940 con 0x7f7cd80cb390 2024-08-17T02:27:35.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.008+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cd8153240 con 0x7f7cd80cb390 2024-08-17T02:27:35.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.008+0000 7f7cd4ff9700 1 -- 172.21.15.155:0/105603552 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7cd8153240 con 0x7f7cd80cb390 2024-08-17T02:27:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:35.012 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 msgr2=0x7f7cbc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 0x7f7cbc062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006fd0 tx=0x7f7cd0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 msgr2=0x7f7cd80acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 0x7f7cd80acbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0015000 tx=0x7f7cc0018000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 shutdown_connections 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cbc060860 0x7f7cbc062d10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7cd8154900 0x7f7cd814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cd80cb390 0x7f7cd80acbe0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0015000 tx=0x7f7cc0018000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 --2- 172.21.15.155:0/105603552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd80b12d0 0x7f7cd8153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 >> 172.21.15.155:0/105603552 conn(0x7f7cd80678d0 msgr2=0x7f7cd806d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 shutdown_connections 2024-08-17T02:27:35.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.012+0000 7f7cddada700 1 -- 172.21.15.155:0/105603552 wait complete. 2024-08-17T02:27:35.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:35.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:35.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 Processor -- start 2024-08-17T02:27:35.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 -- start start 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 0x7fe7a815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a815d810 con 0x7fe7a815d3d0 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80cc020 con 0x7fe7a8156ce0 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7ae12e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80c38c0 con 0x7fe7a81570b0 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7a7fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe7a815d3d0 0x7fe7a8142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42738/0 (socket says 172.21.15.155:42738) 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7a7fff700 1 -- 172.21.15.155:0/3458364575 learned_addr learned my addr 172.21.15.155:0/3458364575 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:35.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7a6ffd700 1 --2- 172.21.15.155:0/3458364575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 0x7fe7a815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.140+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140044227 0 0) 0x7fe7a815d810 con 0x7fe7a815d3d0 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe790003570 con 0x7fe7a815d3d0 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a6ffd700 1 -- 172.21.15.155:0/3458364575 >> v1:172.21.15.189:6789/0 conn(0x7fe7a8156ce0 legacy=0x7fe7a80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086442830 0 0) 0x7fe7a80cc020 con 0x7fe7a8156ce0 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a6ffd700 1 -- 172.21.15.155:0/3458364575 >> v1:172.21.15.155:6789/0 conn(0x7fe7a815d3d0 legacy=0x7fe7a8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a6ffd700 1 -- 172.21.15.155:0/3458364575 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80c3ba0 con 0x7fe7a81570b0 2024-08-17T02:27:35.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a6ffd700 1 --2- 172.21.15.155:0/3458364575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 0x7fe7a815ce90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009910 tx=0x7fe79c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0675873c0255d9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00b680 con 0x7fe7a81570b0 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00b7e0 con 0x7fe7a81570b0 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7a67fc700 1 -- 172.21.15.155:0/3458364575 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00bba0 con 0x7fe7a81570b0 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3458364575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 msgr2=0x7fe7a815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3458364575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 0x7fe7a815ce90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009910 tx=0x7fe79c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3458364575 shutdown_connections 2024-08-17T02:27:35.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3458364575 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a81570b0 0x7fe7a815ce90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3458364575 >> 172.21.15.155:0/3458364575 conn(0x7fe7a80caae0 msgr2=0x7fe7a80caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3458364575 shutdown_connections 2024-08-17T02:27:35.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3458364575 wait complete. 2024-08-17T02:27:35.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 Processor -- start 2024-08-17T02:27:35.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.144+0000 7fe7ae12e700 1 -- start start 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7a81570b0 0x7fe7a80b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 0x7fe7a80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a81525a0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a8151590 con 0x7fe7a81570b0 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a81517e0 con 0x7fe7a815d3d0 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43438/0 (socket says 172.21.15.155:43438) 2024-08-17T02:27:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 -- 172.21.15.155:0/3637726039 learned_addr learned my addr 172.21.15.155:0/3637726039 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a7fff700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 0x7fe7a80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a6ffd700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7a81570b0 0x7fe7a80b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 -- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 msgr2=0x7fe7a80689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 0x7fe7a80689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 -- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7a81570b0 msgr2=0x7fe7a80b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7a81570b0 0x7fe7a80b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 -- 172.21.15.155:0/3637726039 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c009420 con 0x7fe7a8156ce0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a7fff700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 0x7fe7a80689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7a77fe700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe79800c910 tx=0x7fe798001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798006ba0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798006d20 con 0x7fe7a8156ce0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a8151ac0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798012880 con 0x7fe7a8156ce0 2024-08-17T02:27:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.148+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a8152080 con 0x7fe7a8156ce0 2024-08-17T02:27:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.152+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80645c0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.152+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe798012c70 con 0x7fe7a8156ce0 2024-08-17T02:27:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.152+0000 7fe78f7fe700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.152+0000 7fe7a6ffd700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.152+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe79807c8f0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.156+0000 7fe7a6ffd700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 0x7fe794062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8157480 tx=0x7fe79c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.160+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe79804cd40 con 0x7fe7a8156ce0 2024-08-17T02:27:35.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.324+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7a806edd0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.324+0000 7fe78f7fe700 1 -- 172.21.15.155:0/3637726039 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7980160a0 con 0x7fe7a8156ce0 2024-08-17T02:27:35.328 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 msgr2=0x7fe794062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 0x7fe794062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8157480 tx=0x7fe79c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 msgr2=0x7fe7a8150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe79800c910 tx=0x7fe798001700 comp rx=0 tx=0).stop 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 shutdown_connections 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe7a815d3d0 0x7fe7a80689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7a81570b0 0x7fe7a80b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 --2- 172.21.15.155:0/3637726039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7a8156ce0 0x7fe7a8150dd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 >> 172.21.15.155:0/3637726039 conn(0x7fe7a80caae0 msgr2=0x7fe7a8154070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 shutdown_connections 2024-08-17T02:27:35.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.328+0000 7fe7ae12e700 1 -- 172.21.15.155:0/3637726039 wait complete. 2024-08-17T02:27:35.342 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 Processor -- start 2024-08-17T02:27:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 -- start start 2024-08-17T02:27:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2678159300 0x7f26780b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26781596d0 0x7f2678066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26780cba90 con 0x7f267815dbc0 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780b2b60 con 0x7f26781596d0 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f267d327700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780cb160 con 0x7f2678159300 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26781596d0 0x7f2678066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26781596d0 0x7f2678066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43440/0 (socket says 172.21.15.155:43440) 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 -- 172.21.15.155:0/758142425 learned_addr learned my addr 172.21.15.155:0/758142425 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f2676ffd700 1 --2- 172.21.15.155:0/758142425 >> v2:172.21.15.189:3300/0 conn(0x7f2678159300 0x7f26780b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 -- 172.21.15.155:0/758142425 >> v2:172.21.15.189:3300/0 conn(0x7f2678159300 msgr2=0x7f26780b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 --2- 172.21.15.155:0/758142425 >> v2:172.21.15.189:3300/0 conn(0x7f2678159300 0x7f26780b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 -- 172.21.15.155:0/758142425 >> v1:172.21.15.189:6789/0 conn(0x7f267815dbc0 legacy=0x7f26780afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.456+0000 7f26767fc700 1 -- 172.21.15.155:0/758142425 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780cb440 con 0x7f26781596d0 2024-08-17T02:27:35.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f26767fc700 1 --2- 172.21.15.155:0/758142425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f2678066e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2678089460 tx=0x7f2668009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d929fd854649ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f2675ffb700 1 -- 172.21.15.155:0/758142425 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800b860 con 0x7f26781596d0 2024-08-17T02:27:35.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f2675ffb700 1 -- 172.21.15.155:0/758142425 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266800b9c0 con 0x7f26781596d0 2024-08-17T02:27:35.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f2675ffb700 1 -- 172.21.15.155:0/758142425 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800bd60 con 0x7f26781596d0 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- 172.21.15.155:0/758142425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 msgr2=0x7f2678066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 --2- 172.21.15.155:0/758142425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f2678066e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2678089460 tx=0x7f2668009250 comp rx=0 tx=0).stop 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- 172.21.15.155:0/758142425 shutdown_connections 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 --2- 172.21.15.155:0/758142425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f2678066e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 --2- 172.21.15.155:0/758142425 >> v2:172.21.15.189:3300/0 conn(0x7f2678159300 0x7f26780b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- 172.21.15.155:0/758142425 >> 172.21.15.155:0/758142425 conn(0x7f26780682c0 msgr2=0x7f26780686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- 172.21.15.155:0/758142425 shutdown_connections 2024-08-17T02:27:35.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- 172.21.15.155:0/758142425 wait complete. 2024-08-17T02:27:35.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 Processor -- start 2024-08-17T02:27:35.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.460+0000 7f267d327700 1 -- start start 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2678159300 0x7f26781695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 0x7f26780c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780c3cb0 con 0x7f26781596d0 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2678169e20 con 0x7f267815dbc0 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267816a100 con 0x7f2678159300 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43448/0 (socket says 172.21.15.155:43448) 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 -- 172.21.15.155:0/1050075762 learned_addr learned my addr 172.21.15.155:0/1050075762 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f2676ffd700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2678159300 0x7f26781695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26777fe700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 0x7f26780c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 -- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2678159300 msgr2=0x7f26781695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2678159300 0x7f26781695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 -- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 msgr2=0x7f26780c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 0x7f26780c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 -- 172.21.15.155:0/1050075762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680094f0 con 0x7f26781596d0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26777fe700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 0x7f26780c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f26767fc700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26780cde20 tx=0x7f2668017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668024440 con 0x7f26781596d0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680245a0 con 0x7f26781596d0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267816a3e0 con 0x7f26781596d0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668024960 con 0x7f26781596d0 2024-08-17T02:27:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.464+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2678169b30 con 0x7f26781596d0 2024-08-17T02:27:35.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26780c4170 con 0x7f26781596d0 2024-08-17T02:27:35.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f266801a420 con 0x7f26781596d0 2024-08-17T02:27:35.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f265effd700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 0x7f2664062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f266807ea40 con 0x7f26781596d0 2024-08-17T02:27:35.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f2676ffd700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 0x7f2664062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.468+0000 7f2676ffd700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 0x7f2664062d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.476+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2668080e60 con 0x7f26781596d0 2024-08-17T02:27:35.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.636+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26780645c0 con 0x7f26781596d0 2024-08-17T02:27:35.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.636+0000 7f265effd700 1 -- 172.21.15.155:0/1050075762 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f266804ef10 con 0x7f26781596d0 2024-08-17T02:27:35.640 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 msgr2=0x7f2664062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 0x7f2664062d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 msgr2=0x7f26780c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26780cde20 tx=0x7f2668017000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 shutdown_connections 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2664060890 0x7f2664062d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267815dbc0 0x7f26780c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26781596d0 0x7f26780c69a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 --2- 172.21.15.155:0/1050075762 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2678159300 0x7f26781695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 >> 172.21.15.155:0/1050075762 conn(0x7f26780682c0 msgr2=0x7f26781585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 shutdown_connections 2024-08-17T02:27:35.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.640+0000 7f267d327700 1 -- 172.21.15.155:0/1050075762 wait complete. 2024-08-17T02:27:35.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:35.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.756+0000 7f4556bf5700 1 Processor -- start 2024-08-17T02:27:35.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.756+0000 7f4556bf5700 1 -- start start 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45501574f0 0x7f4550157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 0x7f45500b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500b1750 con 0x7f45501574f0 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006e010 con 0x7f45500b0d90 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455006efa0 con 0x7f45501514d0 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45501574f0 0x7f4550157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45501574f0 0x7f4550157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43462/0 (socket says 172.21.15.155:43462) 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 -- 172.21.15.155:0/505883356 learned_addr learned my addr 172.21.15.155:0/505883356 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4555bf3700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45563f4700 1 --2- 172.21.15.155:0/505883356 >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 0x7f45500b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 -- 172.21.15.155:0/505883356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 msgr2=0x7f455006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 -- 172.21.15.155:0/505883356 >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 msgr2=0x7f45500b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 --2- 172.21.15.155:0/505883356 >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 0x7f45500b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 -- 172.21.15.155:0/505883356 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550157fb0 con 0x7f45501574f0 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45563f4700 1 --2- 172.21.15.155:0/505883356 >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 0x7f45500b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f45553f2700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45501574f0 0x7f4550157960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45500ae810 tx=0x7f454c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d67e1a1a8b210a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4554bf1700 1 -- 172.21.15.155:0/505883356 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00e070 con 0x7f45501574f0 2024-08-17T02:27:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4554bf1700 1 -- 172.21.15.155:0/505883356 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c00ba50 con 0x7f45501574f0 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4554bf1700 1 -- 172.21.15.155:0/505883356 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c0092e0 con 0x7f45501574f0 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- 172.21.15.155:0/505883356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45501574f0 msgr2=0x7f4550157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45501574f0 0x7f4550157960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45500ae810 tx=0x7f454c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- 172.21.15.155:0/505883356 shutdown_connections 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45501574f0 0x7f4550157960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- 172.21.15.155:0/505883356 >> v2:172.21.15.189:3300/0 conn(0x7f45500b0d90 0x7f45500b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 --2- 172.21.15.155:0/505883356 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- 172.21.15.155:0/505883356 >> 172.21.15.155:0/505883356 conn(0x7f45500678a0 msgr2=0x7f4550067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- 172.21.15.155:0/505883356 shutdown_connections 2024-08-17T02:27:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.760+0000 7f4556bf5700 1 -- 172.21.15.155:0/505883356 wait complete. 2024-08-17T02:27:35.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 Processor -- start 2024-08-17T02:27:35.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- start start 2024-08-17T02:27:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45501574f0 0x7f45501503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45501555f0 con 0x7f45500b0d90 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550152d90 con 0x7f45501574f0 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4550152180 con 0x7f45501514d0 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43470/0 (socket says 172.21.15.155:43470) 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 -- 172.21.15.155:0/817365591 learned_addr learned my addr 172.21.15.155:0/817365591 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f45553f2700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f45563f4700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45501574f0 0x7f45501503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 -- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 msgr2=0x7f455006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 -- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45501574f0 msgr2=0x7f45501503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45501574f0 0x7f45501503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 -- 172.21.15.155:0/817365591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c009ae0 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f45553f2700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4555bf3700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f454000d890 tx=0x7f4540008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454000b600 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454000b760 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4550152460 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454000bae0 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.764+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4550152a20 con 0x7f45500b0d90 2024-08-17T02:27:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550064330 con 0x7f45500b0d90 2024-08-17T02:27:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f454001e460 con 0x7f45500b0d90 2024-08-17T02:27:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f4545ffb700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 0x7f453c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f454007d2a0 con 0x7f45500b0d90 2024-08-17T02:27:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f45553f2700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 0x7f453c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.768+0000 7f45553f2700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 0x7f453c062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.776+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f454004d6f0 con 0x7f45500b0d90 2024-08-17T02:27:35.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.940+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4550159b50 con 0x7f45500b0d90 2024-08-17T02:27:35.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.944+0000 7f4545ffb700 1 -- 172.21.15.155:0/817365591 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4540050d10 con 0x7f45500b0d90 2024-08-17T02:27:35.946 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:35.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 msgr2=0x7f453c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 0x7f453c062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c018000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 msgr2=0x7f455013d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f454000d890 tx=0x7f4540008040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 shutdown_connections 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f453c060860 0x7f453c062d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45501574f0 0x7f45501503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f45501514d0 0x7f455006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 --2- 172.21.15.155:0/817365591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45500b0d90 0x7f455013d280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 >> 172.21.15.155:0/817365591 conn(0x7f45500678a0 msgr2=0x7f4550158800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 shutdown_connections 2024-08-17T02:27:35.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:35.948+0000 7f4556bf5700 1 -- 172.21.15.155:0/817365591 wait complete. 2024-08-17T02:27:35.965 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:36.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.068+0000 7f0bd2c01700 1 Processor -- start 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.068+0000 7f0bd2c01700 1 -- start start 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.068+0000 7f0bd2c01700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0bcc0d0010 0x7f0bcc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0cf190 con 0x7f0bcc159040 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0d09a0 con 0x7f0bcc15cea0 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0ce5e0 con 0x7f0bcc0d0010 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43482/0 (socket says 172.21.15.155:43482) 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd1bff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0bcc159040 0x7f0bcc0cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42740/0 (socket says 172.21.15.155:42740) 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 -- 172.21.15.155:0/3393694275 learned_addr learned my addr 172.21.15.155:0/3393694275 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd13fe700 1 --2- 172.21.15.155:0/3393694275 >> v2:172.21.15.189:3300/0 conn(0x7f0bcc0d0010 0x7f0bcc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 -- 172.21.15.155:0/3393694275 >> v2:172.21.15.189:3300/0 conn(0x7f0bcc0d0010 msgr2=0x7f0bcc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 --2- 172.21.15.155:0/3393694275 >> v2:172.21.15.189:3300/0 conn(0x7f0bcc0d0010 0x7f0bcc0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 -- 172.21.15.155:0/3393694275 >> v1:172.21.15.155:6789/0 conn(0x7f0bcc159040 legacy=0x7f0bcc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 -- 172.21.15.155:0/3393694275 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0ce860 con 0x7f0bcc15cea0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2400700 1 --2- 172.21.15.155:0/3393694275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc067ef0 tx=0x7f0bc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaba4b032e3ef42e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd0bfd700 1 -- 172.21.15.155:0/3393694275 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400b860 con 0x7f0bcc15cea0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd0bfd700 1 -- 172.21.15.155:0/3393694275 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400b9c0 con 0x7f0bcc15cea0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd0bfd700 1 -- 172.21.15.155:0/3393694275 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400bd80 con 0x7f0bcc15cea0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- 172.21.15.155:0/3393694275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15cea0 msgr2=0x7f0bcc15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/3393694275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc067ef0 tx=0x7f0bc4009250 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- 172.21.15.155:0/3393694275 shutdown_connections 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/3393694275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc15d2e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/3393694275 >> v2:172.21.15.189:3300/0 conn(0x7f0bcc0d0010 0x7f0bcc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- 172.21.15.155:0/3393694275 >> 172.21.15.155:0/3393694275 conn(0x7f0bcc068250 msgr2=0x7f0bcc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- 172.21.15.155:0/3393694275 shutdown_connections 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.072+0000 7f0bd2c01700 1 -- 172.21.15.155:0/3393694275 wait complete. 2024-08-17T02:27:36.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 Processor -- start 2024-08-17T02:27:36.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- start start 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bcc0d0010 0x7f0bcc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc169690 con 0x7f0bcc159040 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0a7e60 con 0x7f0bcc15cea0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc169950 con 0x7f0bcc0d0010 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43496/0 (socket says 172.21.15.155:43496) 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 -- 172.21.15.155:0/2298652350 learned_addr learned my addr 172.21.15.155:0/2298652350 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd1bff700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bcc0d0010 0x7f0bcc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2400700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 -- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bcc0d0010 msgr2=0x7f0bcc151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bcc0d0010 0x7f0bcc151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 -- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 msgr2=0x7f0bcc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 -- 172.21.15.155:0/2298652350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40094f0 con 0x7f0bcc159040 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2400700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd13fe700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009fa0 tx=0x7f0bc8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800ed20 con 0x7f0bcc159040 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800ee80 con 0x7f0bcc159040 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc169c30 con 0x7f0bcc159040 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8014670 con 0x7f0bcc159040 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.076+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc152150 con 0x7f0bcc159040 2024-08-17T02:27:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0643a0 con 0x7f0bcc159040 2024-08-17T02:27:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0bc80149e0 con 0x7f0bcc159040 2024-08-17T02:27:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bc1ffb700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 0x7f0bb8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bd1bff700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 0x7f0bb8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bc807d400 con 0x7f0bcc159040 2024-08-17T02:27:36.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.080+0000 7f0bd1bff700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 0x7f0bb8062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc007fd0 tx=0x7f0bbc007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.088+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0bc804d7b0 con 0x7f0bcc159040 2024-08-17T02:27:36.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.284+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bcc0b3480 con 0x7f0bcc159040 2024-08-17T02:27:36.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bc1ffb700 1 -- 172.21.15.155:0/2298652350 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f0bc80099c0 con 0x7f0bcc159040 2024-08-17T02:27:36.290 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:36.290 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 msgr2=0x7f0bb8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 0x7f0bb8062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc007fd0 tx=0x7f0bbc007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 msgr2=0x7f0bcc0a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009fa0 tx=0x7f0bc8009880 comp rx=0 tx=0).stop 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 shutdown_connections 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0bb8060860 0x7f0bb8062d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bcc15cea0 0x7f0bcc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc159040 0x7f0bcc0a74f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 --2- 172.21.15.155:0/2298652350 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0bcc0d0010 0x7f0bcc151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 >> 172.21.15.155:0/2298652350 conn(0x7f0bcc068250 msgr2=0x7f0bcc152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 shutdown_connections 2024-08-17T02:27:36.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.288+0000 7f0bd2c01700 1 -- 172.21.15.155:0/2298652350 wait complete. 2024-08-17T02:27:36.294 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:36.304 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 Processor -- start 2024-08-17T02:27:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 -- start start 2024-08-17T02:27:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe72406e510 0x7fe7241556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe72413e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724156940 con 0x7fe72406e140 2024-08-17T02:27:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72413ec10 con 0x7fe72406e510 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe728851700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe724155d30 con 0x7fe72413e250 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe72259c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe72406e510 0x7fe7241556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe72359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe72413e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe72259c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe72406e510 0x7fe7241556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:49496/0 (socket says 172.21.15.155:49496) 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe72259c700 1 -- 172.21.15.155:0/3793660232 learned_addr learned my addr 172.21.15.155:0/3793660232 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.408+0000 7fe722d9d700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe72406e140 0x7fe7240b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:56962/0 (socket says 172.21.15.155:56962) 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe72259c700 1 -- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 msgr2=0x7fe72413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe72259c700 1 --2- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe72413e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe72259c700 1 -- 172.21.15.155:0/3793660232 >> v1:172.21.15.189:6789/0 conn(0x7fe72406e140 legacy=0x7fe7240b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe72259c700 1 -- 172.21.15.155:0/3793660232 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724156010 con 0x7fe72406e510 2024-08-17T02:27:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe72259c700 1 --2- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e510 0x7fe7241556f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe714009f20 tx=0x7fe714009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f1b9e301feeed15 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe721d9b700 1 -- 172.21.15.155:0/3793660232 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400e070 con 0x7fe72406e510 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe721d9b700 1 -- 172.21.15.155:0/3793660232 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400b9d0 con 0x7fe72406e510 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe721d9b700 1 -- 172.21.15.155:0/3793660232 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140092e0 con 0x7fe72406e510 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e510 msgr2=0x7fe7241556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 --2- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e510 0x7fe7241556f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe714009f20 tx=0x7fe714009840 comp rx=0 tx=0).stop 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- 172.21.15.155:0/3793660232 shutdown_connections 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 --2- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe72413e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 --2- 172.21.15.155:0/3793660232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e510 0x7fe7241556f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- 172.21.15.155:0/3793660232 >> 172.21.15.155:0/3793660232 conn(0x7fe7240678d0 msgr2=0x7fe724067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- 172.21.15.155:0/3793660232 shutdown_connections 2024-08-17T02:27:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- 172.21.15.155:0/3793660232 wait complete. 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 Processor -- start 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.412+0000 7fe728851700 1 -- start start 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e140 0x7fe72414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe7241680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724169940 con 0x7fe72406e510 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724160150 con 0x7fe72406e140 2024-08-17T02:27:36.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72413d740 con 0x7fe72413e250 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43502/0 (socket says 172.21.15.155:43502) 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 -- 172.21.15.155:0/687989319 learned_addr learned my addr 172.21.15.155:0/687989319 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72359e700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe7241680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe722d9d700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e140 0x7fe72414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 -- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 msgr2=0x7fe7241680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe7241680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 -- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e140 msgr2=0x7fe72414fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e140 0x7fe72414fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 -- 172.21.15.155:0/687989319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009ae0 con 0x7fe72406e510 2024-08-17T02:27:36.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe72259c700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe714003440 tx=0x7fe714018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714008850 con 0x7fe72406e510 2024-08-17T02:27:36.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140089b0 con 0x7fe72406e510 2024-08-17T02:27:36.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714008d30 con 0x7fe72406e510 2024-08-17T02:27:36.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724168630 con 0x7fe72406e510 2024-08-17T02:27:36.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.416+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe724169010 con 0x7fe72406e510 2024-08-17T02:27:36.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe724169af0 con 0x7fe72406e510 2024-08-17T02:27:36.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe714003040 con 0x7fe72406e510 2024-08-17T02:27:36.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe70affd700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 0x7fe710062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe71407e830 con 0x7fe72406e510 2024-08-17T02:27:36.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe722d9d700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 0x7fe710062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.420+0000 7fe722d9d700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 0x7fe710062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.424+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe724169af0 con 0x7fe72406e510 2024-08-17T02:27:36.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.588+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe724169af0 con 0x7fe72406e510 2024-08-17T02:27:36.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.588+0000 7fe70affd700 1 -- 172.21.15.155:0/687989319 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe724169af0 con 0x7fe72406e510 2024-08-17T02:27:36.592 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:36.592 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 msgr2=0x7fe710062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 0x7fe710062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718007e70 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 msgr2=0x7fe72415fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe714003440 tx=0x7fe714018000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 shutdown_connections 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe710060860 0x7fe710062d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe72413e250 0x7fe7241680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72406e510 0x7fe72415fc10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 --2- 172.21.15.155:0/687989319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe72406e140 0x7fe72414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 >> 172.21.15.155:0/687989319 conn(0x7fe7240678d0 msgr2=0x7fe724136e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 shutdown_connections 2024-08-17T02:27:36.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.592+0000 7fe728851700 1 -- 172.21.15.155:0/687989319 wait complete. 2024-08-17T02:27:36.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:36.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.704+0000 7f7952726700 1 Processor -- start 2024-08-17T02:27:36.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.704+0000 7f7952726700 1 -- start start 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f794c068840 0x7f794c068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c0ae8e0 0x7f794c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f794c0aed40 0x7f794c15a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0b0350 con 0x7f794c0aed40 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0af7d0 con 0x7f794c068840 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7952726700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0afab0 con 0x7f794c0ae8e0 2024-08-17T02:27:36.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f794c0aed40 0x7f794c15a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f794c0aed40 0x7f794c15a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43510/0 (socket says 172.21.15.155:43510) 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 -- 172.21.15.155:0/2594665813 learned_addr learned my addr 172.21.15.155:0/2594665813 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7950f23700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c0ae8e0 0x7f794c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951724700 1 --2- 172.21.15.155:0/2594665813 >> v2:172.21.15.189:3300/0 conn(0x7f794c068840 0x7f794c068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 -- 172.21.15.155:0/2594665813 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c0ae8e0 msgr2=0x7f794c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c0ae8e0 0x7f794c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 -- 172.21.15.155:0/2594665813 >> v2:172.21.15.189:3300/0 conn(0x7f794c068840 msgr2=0x7f794c068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 --2- 172.21.15.155:0/2594665813 >> v2:172.21.15.189:3300/0 conn(0x7f794c068840 0x7f794c068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 -- 172.21.15.155:0/2594665813 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0afd90 con 0x7f794c0aed40 2024-08-17T02:27:36.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7951f25700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c15a2d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f794c06d600 tx=0x7f794400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77542bc090f4e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7943fff700 1 -- 172.21.15.155:0/2594665813 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944010070 con 0x7f794c0aed40 2024-08-17T02:27:36.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7943fff700 1 -- 172.21.15.155:0/2594665813 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400dd30 con 0x7f794c0aed40 2024-08-17T02:27:36.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.708+0000 7f7943fff700 1 -- 172.21.15.155:0/2594665813 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400dea0 con 0x7f794c0aed40 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- 172.21.15.155:0/2594665813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 msgr2=0x7f794c15a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c15a2d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f794c06d600 tx=0x7f794400ba50 comp rx=0 tx=0).stop 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- 172.21.15.155:0/2594665813 shutdown_connections 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c15a2d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 --2- 172.21.15.155:0/2594665813 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c0ae8e0 0x7f794c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 --2- 172.21.15.155:0/2594665813 >> v2:172.21.15.189:3300/0 conn(0x7f794c068840 0x7f794c068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- 172.21.15.155:0/2594665813 >> 172.21.15.155:0/2594665813 conn(0x7f794c06d800 msgr2=0x7f794c06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- 172.21.15.155:0/2594665813 shutdown_connections 2024-08-17T02:27:36.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- 172.21.15.155:0/2594665813 wait complete. 2024-08-17T02:27:36.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 Processor -- start 2024-08-17T02:27:36.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.712+0000 7f7952726700 1 -- start start 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c068840 0x7f794c168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794c0ae8e0 0x7f794c13fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0a9a60 con 0x7f794c0aed40 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c168e70 con 0x7f794c0ae8e0 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0a7e90 con 0x7f794c068840 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43514/0 (socket says 172.21.15.155:43514) 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 -- 172.21.15.155:0/3738916661 learned_addr learned my addr 172.21.15.155:0/3738916661 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951724700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c068840 0x7f794c168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7950f23700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794c0ae8e0 0x7f794c13fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 -- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c068840 msgr2=0x7f794c168930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c068840 0x7f794c168930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 -- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794c0ae8e0 msgr2=0x7f794c13fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794c0ae8e0 0x7f794c13fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 -- 172.21.15.155:0/3738916661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794400bcf0 con 0x7f794c0aed40 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7951f25700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f794400b660 tx=0x7f794401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400dea0 con 0x7f794c0aed40 2024-08-17T02:27:36.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400ad10 con 0x7f794c0aed40 2024-08-17T02:27:36.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c140020 con 0x7f794c0aed40 2024-08-17T02:27:36.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440276b0 con 0x7f794c0aed40 2024-08-17T02:27:36.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.716+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0a7560 con 0x7f794c0aed40 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0638f0 con 0x7f794c0aed40 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7944003040 con 0x7f794c0aed40 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f79417fa700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 0x7f7930062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f7951724700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 0x7f7930062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7944080890 con 0x7f794c0aed40 2024-08-17T02:27:36.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.720+0000 7f7951724700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 0x7f7930062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7948009db0 tx=0x7f79480091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.724+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7944050c40 con 0x7f794c0aed40 2024-08-17T02:27:36.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f794c0a7fd0 con 0x7f794c0aed40 2024-08-17T02:27:36.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f79417fa700 1 -- 172.21.15.155:0/3738916661 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f7944054260 con 0x7f794c0aed40 2024-08-17T02:27:36.923 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:36.923 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:36.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 msgr2=0x7f7930062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 0x7f7930062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7948009db0 tx=0x7f79480091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 msgr2=0x7f794c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f794400b660 tx=0x7f794401a000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 shutdown_connections 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7930060860 0x7f7930062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0aed40 0x7f794c06a7f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f794c0ae8e0 0x7f794c13fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 --2- 172.21.15.155:0/3738916661 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f794c068840 0x7f794c168930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 >> 172.21.15.155:0/3738916661 conn(0x7f794c06d800 msgr2=0x7f794c157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 shutdown_connections 2024-08-17T02:27:36.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:36.920+0000 7f7952726700 1 -- 172.21.15.155:0/3738916661 wait complete. 2024-08-17T02:27:36.927 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:37.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:22.024829+0000', 'modified': '2024-08-17T02:27:24.708183+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6833/3348762194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6832', 'nonce': 3348762194}, {'type': 'v1', 'addr': '172.21.15.189:6833', 'nonce': 3348762194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:37.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:37.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:27:37.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 Processor -- start 2024-08-17T02:27:37.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 -- start start 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a815a470 0x7f61a80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 0x7f61a815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a8153da0 con 0x7f61a815a0a0 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a80a9f70 con 0x7f61a815a470 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8069060 con 0x7f61a8068be0 2024-08-17T02:27:37.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a815a470 0x7f61a80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a815a470 0x7f61a80686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43518/0 (socket says 172.21.15.155:43518) 2024-08-17T02:27:37.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 -- 172.21.15.155:0/1213964984 learned_addr learned my addr 172.21.15.155:0/1213964984 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61acf63700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 0x7f61a815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 -- 172.21.15.155:0/1213964984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 msgr2=0x7f61a815b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 0x7f61a815b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 -- 172.21.15.155:0/1213964984 >> v1:172.21.15.189:6789/0 conn(0x7f61a815a0a0 legacy=0x7f61a80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 -- 172.21.15.155:0/1213964984 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a815b260 con 0x7f61a815a470 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61acf63700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 0x7f61a815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a77fe700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a470 0x7f61a80686a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6190009f50 tx=0x7f6190009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3295fa02de4a850e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a6ffd700 1 -- 172.21.15.155:0/1213964984 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000e070 con 0x7f61a815a470 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a6ffd700 1 -- 172.21.15.155:0/1213964984 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619000ba70 con 0x7f61a815a470 2024-08-17T02:27:37.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61a6ffd700 1 -- 172.21.15.155:0/1213964984 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900092e0 con 0x7f61a815a470 2024-08-17T02:27:37.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 -- 172.21.15.155:0/1213964984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a470 msgr2=0x7f61a80686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.456+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a470 0x7f61a80686a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6190009f50 tx=0x7f6190009840 comp rx=0 tx=0).stop 2024-08-17T02:27:37.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- 172.21.15.155:0/1213964984 shutdown_connections 2024-08-17T02:27:37.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a8068be0 0x7f61a815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/1213964984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a470 0x7f61a80686a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- 172.21.15.155:0/1213964984 >> 172.21.15.155:0/1213964984 conn(0x7f61a80cd160 msgr2=0x7f61a806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- 172.21.15.155:0/1213964984 shutdown_connections 2024-08-17T02:27:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- 172.21.15.155:0/1213964984 wait complete. 2024-08-17T02:27:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 Processor -- start 2024-08-17T02:27:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- start start 2024-08-17T02:27:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61a8068be0 0x7f61a813aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a815a470 0x7f61a815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80ae7f0 con 0x7f61a815a0a0 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80af670 con 0x7f61a8068be0 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61ae9c6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80af950 con 0x7f61a815a470 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43526/0 (socket says 172.21.15.155:43526) 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61a77fe700 1 -- 172.21.15.155:0/3530859944 learned_addr learned my addr 172.21.15.155:0/3530859944 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.460+0000 7f61a7fff700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61a8068be0 0x7f61a813aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61acf63700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a815a470 0x7f61a815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 -- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a815a470 msgr2=0x7f61a815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a815a470 0x7f61a815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 -- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61a8068be0 msgr2=0x7f61a813aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61a8068be0 0x7f61a813aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 -- 172.21.15.155:0/3530859944 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009ae0 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61a77fe700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61a8070cc0 tx=0x7f6190018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 -- 172.21.15.155:0/3530859944 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190007970 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 -- 172.21.15.155:0/3530859944 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190007af0 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a80afc30 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 -- 172.21.15.155:0/3530859944 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619001d420 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a813afb0 con 0x7f61a815a0a0 2024-08-17T02:27:37.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 -- 172.21.15.155:0/3530859944 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6190003040 con 0x7f61a815a0a0 2024-08-17T02:27:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 0x7f618c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.464+0000 7f619ffff700 1 -- 172.21.15.155:0/3530859944 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f619007e450 con 0x7f61a815a0a0 2024-08-17T02:27:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.468+0000 7f61a7fff700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 0x7f618c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.468+0000 7f61a7fff700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 0x7f618c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61a0003a80 tx=0x7f61a0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.468+0000 7f61b0c75740 1 Processor -- start 2024-08-17T02:27:37.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.468+0000 7f61b0c75740 1 -- start start 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 0x1746710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x1749c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x16beba0 con 0x1512ae0 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x16bab40 con 0x1512710 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x16800a0 con 0x155d790 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43530/0 (socket says 172.21.15.155:43530) 2024-08-17T02:27:37.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 -- 172.21.15.155:0/2478908213 learned_addr learned my addr 172.21.15.155:0/2478908213 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61acf63700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x1749c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a77fe700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 0x1746710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 -- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 msgr2=0x1749c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x1749c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 -- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 msgr2=0x1746710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 0x1746710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 -- 172.21.15.155:0/2478908213 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x155e9e0 con 0x1512ae0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a77fe700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 0x1746710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61acf63700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x1749c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61a0002730 tx=0x7f61a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498a49d705c7465 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f619d7fa700 1 -- 172.21.15.155:0/2478908213 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0014450 con 0x1512ae0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f619d7fa700 1 -- 172.21.15.155:0/2478908213 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00145b0 con 0x1512ae0 2024-08-17T02:27:37.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f619d7fa700 1 -- 172.21.15.155:0/2478908213 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0014930 con 0x1512ae0 2024-08-17T02:27:37.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- 172.21.15.155:0/2478908213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 msgr2=0x17461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61a0002730 tx=0x7f61a0015000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- 172.21.15.155:0/2478908213 shutdown_connections 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x1749c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512710 0x1746710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2478908213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17461d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- 172.21.15.155:0/2478908213 >> 172.21.15.155:0/2478908213 conn(0x1512eb0 msgr2=0x174c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- 172.21.15.155:0/2478908213 shutdown_connections 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- 172.21.15.155:0/2478908213 wait complete. 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 -- start start 2024-08-17T02:27:37.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.472+0000 7f61b0c75740 1 Processor -- start 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 0x1793dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x174e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x167fd40 con 0x1512710 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x1658970 con 0x1512ae0 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x1672dc0 con 0x155d790 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 10 client.0 _ll_register_callbacks cb 0x165cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43540/0 (socket says 172.21.15.155:43540) 2024-08-17T02:27:37.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 -- 172.21.15.155:0/901354363 learned_addr learned my addr 172.21.15.155:0/901354363 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a77fe700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 0x1793dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61acf63700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x174e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 -- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 msgr2=0x174e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x174e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 -- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 msgr2=0x1793dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 0x1793dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 -- 172.21.15.155:0/901354363 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a8153da0 con 0x1512710 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a77fe700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 0x1793dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a7fff700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61a0002ba0 tx=0x7f61a001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f824ca6e0e3c9e77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0003800 con 0x1512710 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61a001c040 con 0x1512710 2024-08-17T02:27:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1520260 con 0x1512710 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61a0020da0 con 0x1512710 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 10 client.4620 fetch_fsmap learned FSMap version 6 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1688370 con 0x1512710 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1520260 con 0x1512710 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f61a0002050 con 0x1512710 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 10 client.4620 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 10 client.4620 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 20 client.4620 populate_metadata read hostname 'smithi155' 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x179ca20 0x179ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 4 client.4620 mds_command: new command op to 4276 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 --> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x156a4e0 con 0x179ca20 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a77fe700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x179ca20 0x179ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61967fc700 10 client.4620 ms_handle_connect on v2:172.21.15.189:6832/3348762194 2024-08-17T02:27:37.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.476+0000 7f61a77fe700 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x179ca20 0x179ee00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33e3f486a63cda1 server_cookie=cfb7e66da61609b5 in_seq=0 out_seq=0 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61967fc700 1 -- 172.21.15.155:0/901354363 <== mds.0 v2:172.21.15.189:6832/3348762194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x156a4e0 con 0x179ca20 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61967fc700 10 client.4620 handle_command_reply: tid=0 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 client.4620 shutdown 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 msgr2=0x1793890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61a0002ba0 tx=0x7f61a001f000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 shutdown_connections 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x179ca20 0x179ee00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x155d790 0x174e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61967fc700 0 client.4620 ms_handle_reset on v2:172.21.15.189:6832/3348762194 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x1512ae0 0x1793dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 --2- 172.21.15.155:0/901354363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x1793890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 >> 172.21.15.155:0/901354363 conn(0x1512eb0 msgr2=0x1747c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 shutdown_connections 2024-08-17T02:27:37.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 1 -- 172.21.15.155:0/901354363 wait complete. 2024-08-17T02:27:37.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.480+0000 7f61b0c75740 20 client.4620 trim_cache size 0 max 16384 2024-08-17T02:27:37.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 Processor -- start 2024-08-17T02:27:37.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 -- start start 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 0x174d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x179cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x16b6650 con 0x1512710 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x158b7c0 con 0x155d790 2024-08-17T02:27:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x16f0bb0 con 0x1512ae0 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43550/0 (socket says 172.21.15.155:43550) 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 -- 172.21.15.155:0/2385658085 learned_addr learned my addr 172.21.15.155:0/2385658085 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a77fe700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 0x174d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61acf63700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x179cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 -- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 msgr2=0x174d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 0x174d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 -- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 msgr2=0x179cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x179cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 -- 172.21.15.155:0/2385658085 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x166ed80 con 0x1512710 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a77fe700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 0x174d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f61a7fff700 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61a002bb00 tx=0x7f61a002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82edb6157ce5715 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f619dffb700 1 -- 172.21.15.155:0/2385658085 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0002730 con 0x1512710 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f619dffb700 1 -- 172.21.15.155:0/2385658085 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0007870 con 0x1512710 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.500+0000 7f619dffb700 1 -- 172.21.15.155:0/2385658085 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0003800 con 0x1512710 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- 172.21.15.155:0/2385658085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 msgr2=0x174d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61a002bb00 tx=0x7f61a002b000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- 172.21.15.155:0/2385658085 shutdown_connections 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x179cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512ae0 0x174d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 --2- 172.21.15.155:0/2385658085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512710 0x174d000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- 172.21.15.155:0/2385658085 >> 172.21.15.155:0/2385658085 conn(0x1512eb0 msgr2=0x174ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- 172.21.15.155:0/2385658085 shutdown_connections 2024-08-17T02:27:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- 172.21.15.155:0/2385658085 wait complete. 2024-08-17T02:27:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 -- start start 2024-08-17T02:27:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.504+0000 7f61b0c75740 1 Processor -- start 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512710 0x179f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x17a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x16b8500 con 0x1512ae0 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x16be640 con 0x155d790 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x158f650 con 0x1512710 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 10 client.0 _ll_register_callbacks cb 0x14de9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43556/0 (socket says 172.21.15.155:43556) 2024-08-17T02:27:37.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 -- 172.21.15.155:0/1496355868 learned_addr learned my addr 172.21.15.155:0/1496355868 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a7fff700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512710 0x179f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61acf63700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x17a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 -- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512710 msgr2=0x179f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512710 0x179f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 -- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 msgr2=0x17a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x17a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 -- 172.21.15.155:0/1496355868 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1688370 con 0x1512ae0 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a77fe700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61900524f0 tx=0x7f619007e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9b6158fbbe759d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-08-17T02:27:37.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000e040 con 0x1512ae0 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6190052ca0 con 0x1512ae0 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61a00145b0 con 0x1512ae0 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61900557f0 con 0x1512ae0 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 10 client.4626 fetch_fsmap learned FSMap version 6 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1663130 con 0x1512ae0 2024-08-17T02:27:37.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00145b0 con 0x1512ae0 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f619007c140 con 0x1512ae0 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 10 client.4626 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 20 client.4626 populate_metadata read hostname 'smithi155' 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x17a8700 0x17eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 4 client.4626 mds_command: new command op to 4276 tid=0[{"prefix": "status"}] 2024-08-17T02:27:37.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 --> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] -- command(tid 0: {"prefix": "status"}) v1 -- 0x158f260 con 0x17a8700 2024-08-17T02:27:37.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.508+0000 7f61a7fff700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x17a8700 0x17eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61967fc700 10 client.4626 ms_handle_connect on v2:172.21.15.189:6832/3348762194 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61a7fff700 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x17a8700 0x17eb2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b801b5581060bab server_cookie=aa84c34b3a5290c7 in_seq=0 out_seq=0 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61967fc700 1 -- 172.21.15.155:0/1496355868 <== mds.0 v2:172.21.15.189:6832/3348762194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x158f260 con 0x17a8700 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61967fc700 10 client.4626 handle_command_reply: tid=0 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 client.4626 shutdown 2024-08-17T02:27:37.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 msgr2=0x17a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61900524f0 tx=0x7f619007e040 comp rx=0 tx=0).stop 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 shutdown_connections 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x155d790 0x17a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x1512ae0 0x17a7c80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:6832/3348762194,v1:172.21.15.189:6833/3348762194] conn(0x17a8700 0x17eb2c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 --2- 172.21.15.155:0/1496355868 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x1512710 0x179f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 >> 172.21.15.155:0/1496355868 conn(0x1512eb0 msgr2=0x174d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61967fc700 0 client.4626 ms_handle_reset on v2:172.21.15.189:6832/3348762194 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 shutdown_connections 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 1 -- 172.21.15.155:0/1496355868 wait complete. 2024-08-17T02:27:37.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61b0c75740 20 client.4626 trim_cache size 0 max 16384 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "fa54bf99-d4c6-4ed9-b983-a07e3ced1452", 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4276, 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 14.833477979, 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 6, 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 21, 2024-08-17T02:27:37.521 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:27:37.522 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 21.370246013999999 2024-08-17T02:27:37.522 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 msgr2=0x7f618c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 0x7f618c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61a0003a80 tx=0x7f61a0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 msgr2=0x7f61a815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f61a8070cc0 tx=0x7f6190018000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 shutdown_connections 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f618c060860 0x7f618c062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f61a815a470 0x7f61a815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a815a0a0 0x7f61a815b540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 --2- 172.21.15.155:0/3530859944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61a8068be0 0x7f61a813aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 >> 172.21.15.155:0/3530859944 conn(0x7f61a80cd160 msgr2=0x7f61a806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 shutdown_connections 2024-08-17T02:27:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.512+0000 7f61ae9c6700 1 -- 172.21.15.155:0/3530859944 wait complete. 2024-08-17T02:27:37.532 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:27:37.555 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:27:37.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:37.556 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:37.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-08-17T02:27:37.585 INFO:teuthology.orchestra.run.smithi189.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:37.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:37.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:37.587 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-08-17T02:27:37.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:37.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-08-17T02:27:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:37.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:37.658 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:27:37.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.764+0000 7f50e8b52700 1 Processor -- start 2024-08-17T02:27:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.764+0000 7f50e8b52700 1 -- start start 2024-08-17T02:27:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e41536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f50e415a190 0x7f50e415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e415a5f0 con 0x7f50e4153320 2024-08-17T02:27:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e40ce430 con 0x7f50e415a190 2024-08-17T02:27:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e415dbd0 con 0x7f50e40cd1b0 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e2ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e41536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f50e415a190 0x7f50e415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f50e415a190 0x7f50e415cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:49568/0 (socket says 172.21.15.155:49568) 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e2ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e41536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:59062/0 (socket says 172.21.15.155:59062) 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 -- 172.21.15.155:0/1138365826 learned_addr learned my addr 172.21.15.155:0/1138365826 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e37fe700 1 --1- 172.21.15.155:0/1138365826 >> v1:172.21.15.189:6789/0 conn(0x7f50e4153320 0x7f50e40ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:56978/0 (socket says 172.21.15.155:56978) 2024-08-17T02:27:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 -- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 msgr2=0x7f50e41536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 --2- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e41536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 -- 172.21.15.155:0/1138365826 >> v1:172.21.15.189:6789/0 conn(0x7f50e4153320 legacy=0x7f50e40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 -- 172.21.15.155:0/1138365826 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e415d370 con 0x7f50e415a190 2024-08-17T02:27:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e3fff700 1 --2- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e415a190 0x7f50e415cc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009f20 tx=0x7f50dc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd37c8df5dedd219 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e27fc700 1 -- 172.21.15.155:0/1138365826 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00e070 con 0x7f50e415a190 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e27fc700 1 -- 172.21.15.155:0/1138365826 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00b9d0 con 0x7f50e415a190 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e27fc700 1 -- 172.21.15.155:0/1138365826 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0092e0 con 0x7f50e415a190 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e415a190 msgr2=0x7f50e415cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 --2- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e415a190 0x7f50e415cc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009f20 tx=0x7f50dc009840 comp rx=0 tx=0).stop 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- 172.21.15.155:0/1138365826 shutdown_connections 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 --2- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e415a190 0x7f50e415cc60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 --2- 172.21.15.155:0/1138365826 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e41536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- 172.21.15.155:0/1138365826 >> 172.21.15.155:0/1138365826 conn(0x7f50e40d00a0 msgr2=0x7f50e40d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- 172.21.15.155:0/1138365826 shutdown_connections 2024-08-17T02:27:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.768+0000 7f50e8b52700 1 -- 172.21.15.155:0/1138365826 wait complete. 2024-08-17T02:27:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 Processor -- start 2024-08-17T02:27:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- start start 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e40c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e4153320 0x7f50e40b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b3ec0 con 0x7f50e415a190 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4154c00 con 0x7f50e4153320 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40b3980 con 0x7f50e40cd1b0 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43566/0 (socket says 172.21.15.155:43566) 2024-08-17T02:27:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 -- 172.21.15.155:0/2522202178 learned_addr learned my addr 172.21.15.155:0/2522202178 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e37fe700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e40c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e2ffd700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e4153320 0x7f50e40b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 -- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 msgr2=0x7f50e40c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e40c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 -- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e4153320 msgr2=0x7f50e40b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e4153320 0x7f50e40b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 -- 172.21.15.155:0/2522202178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc009ae0 con 0x7f50e415a190 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e3fff700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50e4067f50 tx=0x7f50dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc008b10 con 0x7f50e415a190 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc008cb0 con 0x7f50e415a190 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40b3c40 con 0x7f50e415a190 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0256b0 con 0x7f50e415a190 2024-08-17T02:27:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.772+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4152eb0 con 0x7f50e415a190 2024-08-17T02:27:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e40638f0 con 0x7f50e415a190 2024-08-17T02:27:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f50dc003040 con 0x7f50e415a190 2024-08-17T02:27:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50db7fe700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 0x7f50c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50e37fe700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 0x7f50c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50dc07e740 con 0x7f50e415a190 2024-08-17T02:27:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.776+0000 7f50e37fe700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 0x7f50c8062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50d4004fd0 tx=0x7f50d4007eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.784+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f50dc04eb90 con 0x7f50e415a190 2024-08-17T02:27:37.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50e40cc4d0 con 0x7f50e415a190 2024-08-17T02:27:37.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50db7fe700 1 -- 172.21.15.155:0/2522202178 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50dc0521b0 con 0x7f50e415a190 2024-08-17T02:27:37.983 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 msgr2=0x7f50c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 0x7f50c8062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50d4004fd0 tx=0x7f50d4007eb0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 msgr2=0x7f50e4152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50e4067f50 tx=0x7f50dc018000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 shutdown_connections 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f50c8060860 0x7f50c8062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e415a190 0x7f50e4152090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50e4153320 0x7f50e40b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 --2- 172.21.15.155:0/2522202178 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f50e40cd1b0 0x7f50e40c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 >> 172.21.15.155:0/2522202178 conn(0x7f50e40d00a0 msgr2=0x7f50e415a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 shutdown_connections 2024-08-17T02:27:37.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:37.980+0000 7f50e8b52700 1 -- 172.21.15.155:0/2522202178 wait complete. 2024-08-17T02:27:37.996 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:37.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:37.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-08-17T02:27:37.996 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:37.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:37.997 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:37.997 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:37.997 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:37.997 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:37.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:37.997 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-08-17T02:27:38.001 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:79:63:41:aa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:38.003 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:38.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:27:38.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:27:38.004 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:38.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.045 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:38.100 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-08-17T02:27:38.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.102 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-08-17T02:27:38.124 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-08-17T02:27:38.124 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:38.124 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:38.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:38.126 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:38.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.168 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.217 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-08-17T02:27:38.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.225 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:38.225 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:38.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:38.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:27:38.225 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:38.255 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:27:38.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:27:38.256 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:38.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.388 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:38.388 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:38.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-08-17T02:27:38.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:27:38.389 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:38.416 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:27:38.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:38.417 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:38.422 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:38.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:38.422 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:38.475 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:38.491 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:38.492 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:38.508 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:38.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:38.509 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:38.513 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:38.513 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:27:38.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:38.576 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:38.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:38.591 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:38.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:38.592 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:38.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:2024-08-17T02:27:38.632+0000 7f39d3eeb380 -1 init, newargv = 0x55f422d7d970 newargc=15 2024-08-17T02:27:38.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[30350]: starting ceph client 2024-08-17T02:27:38.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[30350]: starting fuse 2024-08-17T02:27:39.698 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:39.715 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:39.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:39.771 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:39.772 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:39.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:39.773 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:39.777 INFO:teuthology.orchestra.run.smithi155.stdout:51 2024-08-17T02:27:39.778 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [51] 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-08-17T02:27:39.778 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-08-17T02:27:39.779 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:39.780 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:39.780 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.0")) 2024-08-17T02:27:39.780 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-08-17T02:27:39.860 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.0.30350.asok 2024-08-17T02:27:40.044 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.30350.asok 2024-08-17T02:27:40.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:40.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.30350.asok status 2024-08-17T02:27:40.183 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "0", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "30350", 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-08-17T02:27:40.184 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4638, 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4638 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 4244437092 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:27:40.185 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 4244437092 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4638 192.168.0.1:0/4244437092", 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/4244437092", 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 6, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 21, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-08-17T02:27:40.186 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:27:40.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 Processor -- start 2024-08-17T02:27:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 -- start start 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fceb80af030 0x7fceb80a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80b0270 con 0x7fceb80a9260 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80af660 con 0x7fceb815d540 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fcebdf6e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb80af940 con 0x7fceb80af030 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb7fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fceb80a9260 0x7fceb80b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42752/0 (socket says 172.21.15.155:42752) 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb7fff700 1 -- 172.21.15.155:0/2740852748 learned_addr learned my addr 172.21.15.155:0/2740852748 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fceb80af030 0x7fceb80a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb6ffd700 1 -- 172.21.15.155:0/2740852748 >> v1:172.21.15.189:6789/0 conn(0x7fceb815d540 legacy=0x7fceb806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb67fc700 1 -- 172.21.15.155:0/2740852748 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44939484 0 0) 0x7fceb80b0270 con 0x7fceb80a9260 2024-08-17T02:27:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb6ffd700 1 -- 172.21.15.155:0/2740852748 >> v1:172.21.15.155:6789/0 conn(0x7fceb80a9260 legacy=0x7fceb80b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb6ffd700 1 -- 172.21.15.155:0/2740852748 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80afc20 con 0x7fceb80af030 2024-08-17T02:27:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb6ffd700 1 --2- 172.21.15.155:0/2740852748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80af030 0x7fceb80a8d20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ff960379a5e440 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb67fc700 1 -- 172.21.15.155:0/2740852748 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000e070 con 0x7fceb80af030 2024-08-17T02:27:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb67fc700 1 -- 172.21.15.155:0/2740852748 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000bc30 con 0x7fceb80af030 2024-08-17T02:27:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.300+0000 7fceb67fc700 1 -- 172.21.15.155:0/2740852748 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0012430 con 0x7fceb80af030 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2740852748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80af030 msgr2=0x7fceb80a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2740852748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80af030 0x7fceb80a8d20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2740852748 shutdown_connections 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2740852748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80af030 0x7fceb80a8d20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2740852748 >> 172.21.15.155:0/2740852748 conn(0x7fceb8066e00 msgr2=0x7fceb8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2740852748 shutdown_connections 2024-08-17T02:27:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2740852748 wait complete. 2024-08-17T02:27:40.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 Processor -- start 2024-08-17T02:27:40.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.304+0000 7fcebdf6e700 1 -- start start 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb80af030 0x7fceb80aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb815d540 0x7fceb80ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8099310 con 0x7fceb80a9260 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8098940 con 0x7fceb815d540 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8097d30 con 0x7fceb80af030 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43574/0 (socket says 172.21.15.155:43574) 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 -- 172.21.15.155:0/2546118883 learned_addr learned my addr 172.21.15.155:0/2546118883 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:40.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb6ffd700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb80af030 0x7fceb80aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb7fff700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb815d540 0x7fceb80ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 -- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb80af030 msgr2=0x7fceb80aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb80af030 0x7fceb80aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 -- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb815d540 msgr2=0x7fceb80ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb815d540 0x7fceb80ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 -- 172.21.15.155:0/2546118883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009a20 con 0x7fceb80a9260 2024-08-17T02:27:40.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceb77fe700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c590 tx=0x7fcea0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011590 con 0x7fceb80a9260 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0011730 con 0x7fceb80a9260 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8098010 con 0x7fceb80a9260 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011af0 con 0x7fceb80a9260 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb80985d0 con 0x7fceb80a9260 2024-08-17T02:27:40.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.308+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80645c0 con 0x7fceb80a9260 2024-08-17T02:27:40.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.312+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcea0012420 con 0x7fceb80a9260 2024-08-17T02:27:40.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.312+0000 7fceaf7fe700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 0x7fce98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.312+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcea007be30 con 0x7fceb80a9260 2024-08-17T02:27:40.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.312+0000 7fceb6ffd700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 0x7fce98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.312+0000 7fceb6ffd700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 0x7fce98062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.320+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcea004a480 con 0x7fceb80a9260 2024-08-17T02:27:40.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.520+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fceb806f360 con 0x7fceb80a9260 2024-08-17T02:27:40.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fceaf7fe700 1 -- 172.21.15.155:0/2546118883 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcea0017020 con 0x7fceb80a9260 2024-08-17T02:27:40.526 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:40.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 msgr2=0x7fce98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 0x7fce98062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009e60 tx=0x7fceb0019000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 msgr2=0x7fceb8098dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c590 tx=0x7fcea0007f30 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 shutdown_connections 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce98060860 0x7fce98062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb815d540 0x7fceb80ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb80af030 0x7fceb80aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 --2- 172.21.15.155:0/2546118883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb80a9260 0x7fceb8098dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 >> 172.21.15.155:0/2546118883 conn(0x7fceb8066e00 msgr2=0x7fceb806d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 shutdown_connections 2024-08-17T02:27:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:40.524+0000 7fcebdf6e700 1 -- 172.21.15.155:0/2546118883 wait complete. 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:40.540 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:40.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.540 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:40.548 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42588sec preferred_lft 42588sec 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:79:63:41:aa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:40.549 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:42:1b:69:27:96 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b85f:afff:fe4a:5177/64 scope link 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:42:1b:69:27:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c42:1bff:fe69:2796/64 scope link 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.550 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-08-17T02:27:40.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.604 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-08-17T02:27:40.613 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-08-17T02:27:40.613 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:40.613 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:40.613 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:40.614 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:40.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:40.614 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:40.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.653 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-08-17T02:27:40.704 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:40.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.705 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-08-17T02:27:40.711 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:27:40.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.712 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:40.712 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:40.712 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:40.712 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:27:40.712 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:40.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:40.756 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 56:14:ec:b3:21:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5414:ecff:feb3:2113/64 scope link 2024-08-17T02:27:40.757 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 56:14:ec:b3:21:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5414:ecff:feb3:2113/64 scope link 2024-08-17T02:27:40.772 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:40.773 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:27:40.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.773 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:40.773 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:27:40.774 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.880 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:27:40.880 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:27:40.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2024-08-17T02:27:40.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:27:40.880 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:27:40.906 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:27:40.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:40.906 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:40.913 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:40.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:40.913 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:40.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:40.978 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:40.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:40.989 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:40.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:40.990 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:40.995 INFO:teuthology.orchestra.run.smithi155.stdout:51 2024-08-17T02:27:40.995 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [51] 2024-08-17T02:27:40.995 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:27:40.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:41.011 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:41.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:41.068 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:41.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:41.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:41.069 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:41.073 INFO:teuthology.orchestra.run.smithi155.stdout:51 2024-08-17T02:27:41.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:2024-08-17T02:27:41.080+0000 7f7c1a9c7380 -1 init, newargv = 0x55a96d8e3860 newargc=15 2024-08-17T02:27:41.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:ceph-fuse[30489]: starting ceph client 2024-08-17T02:27:41.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi155.stderr:ceph-fuse[30489]: starting fuse 2024-08-17T02:27:42.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:42.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:42.253 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:42.253 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:42.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:42.254 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:27:42.261 INFO:teuthology.orchestra.run.smithi155.stdout:51 2024-08-17T02:27:42.261 INFO:teuthology.orchestra.run.smithi155.stdout:53 2024-08-17T02:27:42.261 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [51, 53] 2024-08-17T02:27:42.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:42.261 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-08-17T02:27:42.261 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-08-17T02:27:42.261 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:42.262 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.2")) 2024-08-17T02:27:42.263 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-08-17T02:27:42.344 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.2.30489.asok 2024-08-17T02:27:42.526 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.30489.asok 2024-08-17T02:27:42.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:42.527 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.30489.asok status 2024-08-17T02:27:42.620 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:27:42.620 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-08-17T02:27:42.620 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:42.620 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "2", 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "30489", 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4653, 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4653 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3794637421 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3794637421 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4653 192.168.0.2:0/3794637421", 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.2:0/3794637421", 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 6, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 21, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:27:42.630 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:42.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 Processor -- start 2024-08-17T02:27:42.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 -- start start 2024-08-17T02:27:42.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35cc0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0cef40 con 0x7f35cc0cddc0 2024-08-17T02:27:42.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0ce330 con 0x7f35cc159340 2024-08-17T02:27:42.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d3dcc700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0ad930 con 0x7f35cc0cb950 2024-08-17T02:27:42.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d1367700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f35cc0cddc0 0x7f35cc0cb240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42766/0 (socket says 172.21.15.155:42766) 2024-08-17T02:27:42.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d1367700 1 -- 172.21.15.155:0/717501927 learned_addr learned my addr 172.21.15.155:0/717501927 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:42.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d2369700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35cc0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246613595 0 0) 0x7f35cc0cef40 con 0x7f35cc0cddc0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b8003570 con 0x7f35cc0cddc0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069229314 0 0) 0x7f35cc0ce330 con 0x7f35cc159340 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35cc0cef40 con 0x7f35cc159340 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1943052611 0 0) 0x7f35b8003570 con 0x7f35cc0cddc0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 msgr2=0x7f35cc0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35cc0ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 >> v1:172.21.15.189:6789/0 conn(0x7f35cc159340 legacy=0x7f35cc0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0ce610 con 0x7f35cc0cddc0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f35b4001470 con 0x7f35cc0cddc0 2024-08-17T02:27:42.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 >> v1:172.21.15.155:6789/0 conn(0x7f35cc0cddc0 legacy=0x7f35cc0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.732+0000 7f35d0b66700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8003c20 0x7f35b8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b8004810 0x7f35b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0ad930 con 0x7f35b8004810 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b800bb40 con 0x7f35b8003c20 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b800bd00 con 0x7f35cc0cb950 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b8004810 0x7f35b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d2369700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1b68700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8003c20 0x7f35b8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 -- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 msgr2=0x7f35b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0cb950 0x7f35b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 -- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8003c20 msgr2=0x7f35b8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8003c20 0x7f35b8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 -- 172.21.15.155:0/717501927 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8003570 con 0x7f35b8004810 2024-08-17T02:27:42.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d1367700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b8004810 0x7f35b8004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35b400c2d0 tx=0x7f35b4001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3711ea20179380 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400cba0 con 0x7f35b8004810 2024-08-17T02:27:42.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400cd20 con 0x7f35b8004810 2024-08-17T02:27:42.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d0b66700 1 -- 172.21.15.155:0/717501927 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4005b70 con 0x7f35b8004810 2024-08-17T02:27:42.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 -- 172.21.15.155:0/717501927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b8004810 msgr2=0x7f35b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/717501927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35b8004810 0x7f35b8004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35b400c2d0 tx=0x7f35b4001e10 comp rx=0 tx=0).stop 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d2369700 1 -- 172.21.15.155:0/717501927 reap_dead start 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 -- 172.21.15.155:0/717501927 shutdown_connections 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 -- 172.21.15.155:0/717501927 >> 172.21.15.155:0/717501927 conn(0x7f35cc0994e0 msgr2=0x7f35cc0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 -- 172.21.15.155:0/717501927 shutdown_connections 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.736+0000 7f35d3dcc700 1 -- 172.21.15.155:0/717501927 wait complete. 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 Processor -- start 2024-08-17T02:27:42.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 -- start start 2024-08-17T02:27:42.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8004810 0x7f35cc146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0c4380 0x7f35cc16c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0c7b50 con 0x7f35cc0c6520 2024-08-17T02:27:42.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0c69e0 con 0x7f35b8004810 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d3dcc700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0c7dc0 con 0x7f35cc0c4380 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43588/0 (socket says 172.21.15.155:43588) 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1b68700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8004810 0x7f35cc146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d2369700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0c4380 0x7f35cc16c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 -- 172.21.15.155:0/365800194 learned_addr learned my addr 172.21.15.155:0/365800194 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 -- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0c4380 msgr2=0x7f35cc16c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0c4380 0x7f35cc16c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 -- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8004810 msgr2=0x7f35cc146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8004810 0x7f35cc146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 -- 172.21.15.155:0/365800194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0c80a0 con 0x7f35cc0c6520 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.740+0000 7f35d1367700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35b800bb10 tx=0x7f35b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4007880 con 0x7f35cc0c6520 2024-08-17T02:27:42.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400cba0 con 0x7f35cc0c6520 2024-08-17T02:27:42.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4012670 con 0x7f35cc0c6520 2024-08-17T02:27:42.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc0c6cc0 con 0x7f35cc0c6520 2024-08-17T02:27:42.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc16a4b0 con 0x7f35cc0c6520 2024-08-17T02:27:42.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc0c8230 con 0x7f35cc0c6520 2024-08-17T02:27:42.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f35b4019030 con 0x7f35cc0c6520 2024-08-17T02:27:42.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 0x7f35ac062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35b407de60 con 0x7f35cc0c6520 2024-08-17T02:27:42.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.744+0000 7f35d1b68700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 0x7f35ac062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.748+0000 7f35d1b68700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 0x7f35ac062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001460 tx=0x7f35bc0017a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.752+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f35b404e2d0 con 0x7f35cc0c6520 2024-08-17T02:27:42.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.948+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35cc0645c0 con 0x7f35cc0c6520 2024-08-17T02:27:42.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.948+0000 7f35c9ffb700 1 -- 172.21.15.155:0/365800194 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f35b4001b30 con 0x7f35cc0c6520 2024-08-17T02:27:42.952 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:42.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 msgr2=0x7f35ac062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 0x7f35ac062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001460 tx=0x7f35bc0017a0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 msgr2=0x7f35cc0c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35b800bb10 tx=0x7f35b4015000 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 shutdown_connections 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f35ac060890 0x7f35ac062d40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f35cc0c4380 0x7f35cc16c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35cc0c6520 0x7f35cc0c3e40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 --2- 172.21.15.155:0/365800194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35b8004810 0x7f35cc146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 >> 172.21.15.155:0/365800194 conn(0x7f35cc0994e0 msgr2=0x7f35cc0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 shutdown_connections 2024-08-17T02:27:42.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:42.952+0000 7f35d3dcc700 1 -- 172.21.15.155:0/365800194 wait complete. 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi189.front.sepia.ceph.com 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:42.974 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:42.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.975 DEBUG:teuthology.orchestra.run.smithi189:> ip addr 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:18 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:19 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:42.983 INFO:teuthology.orchestra.run.smithi189.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.21.15.189/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft 42590sec preferred_lft 42590sec 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::ec4:7aff:fe88:6df1/64 scope link 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 02:42:be:e1:db:76 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:42.984 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:42.985 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:27:42.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip addr flush dev ceph-brx 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set ceph-brx up 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:27:42.985 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:43.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.072 DEBUG:teuthology.orchestra.run.smithi189:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:43.082 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-08-17T02:27:43.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.083 DEBUG:teuthology.orchestra.run.smithi189:> route 2024-08-17T02:27:43.110 INFO:teuthology.orchestra.run.smithi189.stdout:Kernel IP routing table 2024-08-17T02:27:43.110 INFO:teuthology.orchestra.run.smithi189.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:43.110 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:43.110 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:43.111 INFO:teuthology.orchestra.run.smithi189.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:43.111 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:43.111 INFO:teuthology.orchestra.run.smithi189.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:43.111 INFO:teuthology.orchestra.run.smithi189.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:43.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:43.111 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:43.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.153 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-08-17T02:27:43.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.202 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list-id 2024-08-17T02:27:43.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:27:43.209 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:43.238 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:27:43.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.238 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:43.238 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:43.238 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:27:43.238 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:43.239 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:27:43.239 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:27:43.239 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:27:43.239 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.352 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:43.352 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:43.352 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set brx.0 up 2024-08-17T02:27:43.352 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:27:43.352 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:43.379 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:27:43.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:43.379 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:43.386 INFO:teuthology.orchestra.run.smithi189.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:43.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:43.386 DEBUG:teuthology.orchestra.run.smithi189:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:43.433 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:43.448 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:43.448 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:43.463 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:43.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:43.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:43.465 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:43.517 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:43.517 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:27:43.520 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:43.536 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:43.536 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:43.546 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:43.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:43.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:43.548 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:43.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:2024-08-17T02:27:43.598+0000 7f3bed83b380 -1 init, newargv = 0x55691779bae0 newargc=15 2024-08-17T02:27:43.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:ceph-fuse[29702]: starting ceph client 2024-08-17T02:27:43.612 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:ceph-fuse[29702]: starting fuse 2024-08-17T02:27:44.654 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:44.672 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:44.672 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:44.688 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:44.688 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:44.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:44.689 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:44.737 INFO:teuthology.orchestra.run.smithi189.stdout:52 2024-08-17T02:27:44.738 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> import glob 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> import re 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> import os 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> import subprocess 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> def _find_admin_socket(client_name): 2024-08-17T02:27:44.738 DEBUG:teuthology.orchestra.run.smithi189:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> files = glob.glob(asok_path) 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> # Given a non-glob path, it better be there 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> if "*" not in asok_path: 2024-08-17T02:27:44.739 DEBUG:teuthology.orchestra.run.smithi189:> assert(len(files) == 1) 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> return files[0] 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> for f in files: 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> contents = proc_f.read() 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> if mountpoint in contents: 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> return f 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> print(_find_admin_socket("client.1")) 2024-08-17T02:27:44.740 DEBUG:teuthology.orchestra.run.smithi189:> ' 2024-08-17T02:27:44.824 INFO:teuthology.orchestra.run.smithi189.stdout:/var/run/ceph/ceph-client.1.29702.asok 2024-08-17T02:27:45.009 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29702.asok 2024-08-17T02:27:45.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:45.010 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29702.asok status 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "metadata": { 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "entity_id": "1", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "hostname": "smithi189", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "pid": "29702", 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "root": "/" 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:45.103 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_count": 0, 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "id": 4514, 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "inst": { 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "name": { 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "client", 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "num": 4514 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 889719263 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:27:45.104 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 889719263 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "inst_str": "client.4514 192.168.0.1:0/889719263", 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "addr_str": "192.168.0.1:0/889719263", 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "inode_count": 1, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_epoch": 6, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch": 21, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "blocklisted": false, 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout: "fs_name": "cephfs" 2024-08-17T02:27:45.105 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-08-17T02:27:45.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:45.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 Processor -- start 2024-08-17T02:27:45.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 -- start start 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8128142860 0x7f812806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8128142c30 0x7f812806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f812806f2d0 0x7f81280b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8128159790 con 0x7f812806f2d0 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81280b2220 con 0x7f8128142860 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81280b2500 con 0x7f8128142c30 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f812806f2d0 0x7f81280b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f812806f2d0 0x7f81280b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52326/0 (socket says 172.21.15.155:52326) 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 -- 172.21.15.155:0/220677103 learned_addr learned my addr 172.21.15.155:0/220677103 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:45.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8125d9b700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8128142c30 0x7f812806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f812659c700 1 --2- 172.21.15.155:0/220677103 >> v2:172.21.15.189:3300/0 conn(0x7f8128142860 0x7f812806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 -- 172.21.15.155:0/220677103 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8128142c30 msgr2=0x7f812806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8128142c30 0x7f812806ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 -- 172.21.15.155:0/220677103 >> v2:172.21.15.189:3300/0 conn(0x7f8128142860 msgr2=0x7f812806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 --2- 172.21.15.155:0/220677103 >> v2:172.21.15.189:3300/0 conn(0x7f8128142860 0x7f812806e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.224+0000 7f8126d9d700 1 -- 172.21.15.155:0/220677103 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280b27e0 con 0x7f812806f2d0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f8126d9d700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f812806f2d0 0x7f81280b0e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f812806d110 tx=0x7f8120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d585f7e2c6963c21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812559a700 1 -- 172.21.15.155:0/220677103 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000b640 con 0x7f812806f2d0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812559a700 1 -- 172.21.15.155:0/220677103 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000b7a0 con 0x7f812806f2d0 2024-08-17T02:27:45.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812559a700 1 -- 172.21.15.155:0/220677103 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000bb60 con 0x7f812806f2d0 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- 172.21.15.155:0/220677103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f812806f2d0 msgr2=0x7f81280b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f812806f2d0 0x7f81280b0e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f812806d110 tx=0x7f8120009250 comp rx=0 tx=0).stop 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- 172.21.15.155:0/220677103 shutdown_connections 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f812806f2d0 0x7f81280b0e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 --2- 172.21.15.155:0/220677103 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8128142c30 0x7f812806ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 --2- 172.21.15.155:0/220677103 >> v2:172.21.15.189:3300/0 conn(0x7f8128142860 0x7f812806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- 172.21.15.155:0/220677103 >> 172.21.15.155:0/220677103 conn(0x7f81280ca2b0 msgr2=0x7f812806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- 172.21.15.155:0/220677103 shutdown_connections 2024-08-17T02:27:45.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- 172.21.15.155:0/220677103 wait complete. 2024-08-17T02:27:45.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 Processor -- start 2024-08-17T02:27:45.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.228+0000 7f812759e700 1 -- start start 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812806f2d0 0x7f8128137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 0x7f812813f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812815ddc0 con 0x7f8128142860 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81281375d0 con 0x7f8128142c30 2024-08-17T02:27:45.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812815d240 con 0x7f812806f2d0 2024-08-17T02:27:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52338/0 (socket says 172.21.15.155:52338) 2024-08-17T02:27:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 -- 172.21.15.155:0/1531013334 learned_addr learned my addr 172.21.15.155:0/1531013334 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812659c700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812806f2d0 0x7f8128137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8126d9d700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 0x7f812813f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 -- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812806f2d0 msgr2=0x7f8128137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812806f2d0 0x7f8128137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 -- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 msgr2=0x7f812813f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 0x7f812813f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 -- 172.21.15.155:0/1531013334 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200094f0 con 0x7f8128142860 2024-08-17T02:27:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8126d9d700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 0x7f812813f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f8125d9b700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8110009e70 tx=0x7f811000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000caa0 con 0x7f8128142860 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000f040 con 0x7f8128142860 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812815d520 con 0x7f8128142860 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000ce70 con 0x7f8128142860 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812815dae0 con 0x7f8128142860 2024-08-17T02:27:45.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.232+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81280643a0 con 0x7f8128142860 2024-08-17T02:27:45.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.236+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8110014690 con 0x7f8128142860 2024-08-17T02:27:45.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.236+0000 7f811e7fc700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 0x7f8108062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.236+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f811007d760 con 0x7f8128142860 2024-08-17T02:27:45.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.236+0000 7f812659c700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 0x7f8108062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.236+0000 7f812659c700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 0x7f8108062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8118009db0 tx=0x7f81180091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.244+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8110051640 con 0x7f8128142860 2024-08-17T02:27:45.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.444+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f812815ca40 con 0x7f8128142860 2024-08-17T02:27:45.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.444+0000 7f811e7fc700 1 -- 172.21.15.155:0/1531013334 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8110018060 con 0x7f8128142860 2024-08-17T02:27:45.447 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 msgr2=0x7f8108062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 0x7f8108062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8118009db0 tx=0x7f81180091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 msgr2=0x7f812816cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8110009e70 tx=0x7f811000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 shutdown_connections 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8108060860 0x7f8108062d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8128142c30 0x7f812813f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8128142860 0x7f812816cec0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 --2- 172.21.15.155:0/1531013334 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f812806f2d0 0x7f8128137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 >> 172.21.15.155:0/1531013334 conn(0x7f81280ca2b0 msgr2=0x7f81280ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 shutdown_connections 2024-08-17T02:27:45.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:45.448+0000 7f812759e700 1 -- 172.21.15.155:0/1531013334 wait complete. 2024-08-17T02:27:45.462 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:45.462 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:45.462 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi189.front.sepia.ceph.com 2024-08-17T02:27:45.462 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:27:45.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:45.463 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:45.463 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:45.463 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:45.463 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:27:45.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.463 DEBUG:teuthology.orchestra.run.smithi189:> ip addr 2024-08-17T02:27:45.471 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:45.471 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:18 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:19 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:45.472 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.21.15.189/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft 42588sec preferred_lft 42588sec 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::ec4:7aff:fe88:6df1/64 scope link 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 02:42:be:e1:db:76 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 7a:43:b5:b0:3e:28 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::f8a2:88ff:fee5:d898/64 scope link 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.474 INFO:teuthology.orchestra.run.smithi189.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:45.474 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 7a:43:b5:b0:3e:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:45.474 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::7843:b5ff:feb0:3e28/64 scope link 2024-08-17T02:27:45.474 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.474 DEBUG:teuthology.orchestra.run.smithi189:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:45.489 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-08-17T02:27:45.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.491 DEBUG:teuthology.orchestra.run.smithi189:> route 2024-08-17T02:27:45.499 INFO:teuthology.orchestra.run.smithi189.stdout:Kernel IP routing table 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run.smithi189.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:45.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.500 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:45.500 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:45.500 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:45.500 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:45.501 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:45.501 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:45.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.535 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-08-17T02:27:45.586 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:45.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.587 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list-id 2024-08-17T02:27:45.594 INFO:teuthology.orchestra.run.smithi189.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:27:45.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.594 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:45.594 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:45.594 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:45.594 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:27:45.594 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:45.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.622 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:45.682 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 5e:25:4c:7e:a1:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:45.683 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:45.683 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.683 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::5c25:4cff:fe7e:a160/64 scope link 2024-08-17T02:27:45.683 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.684 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 5e:25:4c:7e:a1:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:45.696 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:45.697 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.697 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::5c25:4cff:fe7e:a160/64 scope link 2024-08-17T02:27:45.697 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.697 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:27:45.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:27:45.698 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.752 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:27:45.752 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:27:45.752 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set brx.1 up 2024-08-17T02:27:45.752 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:27:45.752 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:27:45.778 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:27:45.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:45.778 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi189.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:45.785 DEBUG:teuthology.orchestra.run.smithi189:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:45.790 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:45.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:45.804 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:45.818 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:45.819 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:45.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:45.820 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:45.869 INFO:teuthology.orchestra.run.smithi189.stdout:52 2024-08-17T02:27:45.870 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:27:45.870 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:27:45.872 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:45.887 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:45.887 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:45.901 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:45.902 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:45.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:45.902 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:45.950 INFO:teuthology.orchestra.run.smithi189.stdout:52 2024-08-17T02:27:45.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi189.stderr:2024-08-17T02:27:45.950+0000 7f6146d54380 -1 init, newargv = 0x556c9d052710 newargc=15 2024-08-17T02:27:45.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi189.stderr:ceph-fuse[29815]: starting ceph client 2024-08-17T02:27:45.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi189.stderr:ceph-fuse[29815]: starting fuse 2024-08-17T02:27:47.052 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:27:47.071 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:47.071 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:47.131 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:47.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:47.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.132 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:27:47.139 INFO:teuthology.orchestra.run.smithi189.stdout:52 2024-08-17T02:27:47.139 INFO:teuthology.orchestra.run.smithi189.stdout:53 2024-08-17T02:27:47.139 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> import glob 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> import re 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> import os 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> import subprocess 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> def _find_admin_socket(client_name): 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> files = glob.glob(asok_path) 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> # Given a non-glob path, it better be there 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> if "*" not in asok_path: 2024-08-17T02:27:47.140 DEBUG:teuthology.orchestra.run.smithi189:> assert(len(files) == 1) 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> return files[0] 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> for f in files: 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> contents = proc_f.read() 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> if mountpoint in contents: 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> return f 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> print(_find_admin_socket("client.3")) 2024-08-17T02:27:47.141 DEBUG:teuthology.orchestra.run.smithi189:> ' 2024-08-17T02:27:47.220 INFO:teuthology.orchestra.run.smithi189.stdout:/var/run/ceph/ceph-client.3.29815.asok 2024-08-17T02:27:47.406 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.29815.asok 2024-08-17T02:27:47.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.406 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.29815.asok status 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout: "metadata": { 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout: "entity_id": "3", 2024-08-17T02:27:47.498 INFO:teuthology.orchestra.run.smithi189.stdout: "hostname": "smithi189", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "pid": "29815", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "root": "/" 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_count": 0, 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "id": 4526, 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "inst": { 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "name": { 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "client", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "num": 4526 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:27:47.499 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 4146687716 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 4146687716 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "inst_str": "client.4526 192.168.0.2:0/4146687716", 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "addr_str": "192.168.0.2:0/4146687716", 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "inode_count": 1, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_epoch": 6, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch": 21, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:47.500 INFO:teuthology.orchestra.run.smithi189.stdout: "blocklisted": false, 2024-08-17T02:27:47.501 INFO:teuthology.orchestra.run.smithi189.stdout: "fs_name": "cephfs" 2024-08-17T02:27:47.501 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.508 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-08-17T02:27:47.508 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-08-17T02:27:47.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:47.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.536 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-08-17T02:27:47.536 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-08-17T02:27:47.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:47.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:47.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.607 DEBUG:teuthology.orchestra.run.smithi189:> stat --file-system '--printf=%T 2024-08-17T02:27:47.607 DEBUG:teuthology.orchestra.run.smithi189:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi189.stdout:fuseblk 2024-08-17T02:27:47.616 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.617 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:47.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.679 DEBUG:teuthology.orchestra.run.smithi189:> stat --file-system '--printf=%T 2024-08-17T02:27:47.679 DEBUG:teuthology.orchestra.run.smithi189:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:47.687 INFO:teuthology.orchestra.run.smithi189.stdout:fuseblk 2024-08-17T02:27:47.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:47.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:47.687 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:47.698 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:27:47.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:47.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 Processor -- start 2024-08-17T02:27:47.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 -- start start 2024-08-17T02:27:47.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 0x7ff65c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c15dbd0 con 0x7ff65c15a190 2024-08-17T02:27:47.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0ce430 con 0x7ff65c153320 2024-08-17T02:27:47.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff661302700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c15d370 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65bfff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 0x7ff65c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65b7fe700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff65c15a190 0x7ff65c0ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:40816/0 (socket says 172.21.15.155:40816) 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65b7fe700 1 -- 172.21.15.155:0/2592785592 learned_addr learned my addr 172.21.15.155:0/2592785592 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 --2- 172.21.15.155:0/2592785592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65affd700 1 -- 172.21.15.155:0/2592785592 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147146584 0 0) 0x7ff65c15dbd0 con 0x7ff65c15a190 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65affd700 1 -- 172.21.15.155:0/2592785592 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff648003570 con 0x7ff65c15a190 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 -- 172.21.15.155:0/2592785592 >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 msgr2=0x7ff65c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 --2- 172.21.15.155:0/2592785592 >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 0x7ff65c1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 -- 172.21.15.155:0/2592785592 >> v1:172.21.15.189:6789/0 conn(0x7ff65c15a190 legacy=0x7ff65c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 -- 172.21.15.155:0/2592785592 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c15a590 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65bfff700 1 --2- 172.21.15.155:0/2592785592 >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 0x7ff65c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff660b01700 1 --2- 172.21.15.155:0/2592785592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c15cc60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff654009e60 tx=0x7ff654009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575317ba432aab95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65affd700 1 -- 172.21.15.155:0/2592785592 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400e070 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65affd700 1 -- 172.21.15.155:0/2592785592 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400bab0 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.832+0000 7ff65affd700 1 -- 172.21.15.155:0/2592785592 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400be70 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- 172.21.15.155:0/2592785592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 msgr2=0x7ff65c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- 172.21.15.155:0/2592785592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c15cc60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff654009e60 tx=0x7ff654009780 comp rx=0 tx=0).stop 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- 172.21.15.155:0/2592785592 shutdown_connections 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- 172.21.15.155:0/2592785592 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c15cc60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- 172.21.15.155:0/2592785592 >> v2:172.21.15.189:3300/0 conn(0x7ff65c153320 0x7ff65c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- 172.21.15.155:0/2592785592 >> 172.21.15.155:0/2592785592 conn(0x7ff65c0d00a0 msgr2=0x7ff65c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- 172.21.15.155:0/2592785592 shutdown_connections 2024-08-17T02:27:47.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- 172.21.15.155:0/2592785592 wait complete. 2024-08-17T02:27:47.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 Processor -- start 2024-08-17T02:27:47.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- start start 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c16c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c16d560 con 0x7ff65c153320 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b5880 con 0x7ff65c15a190 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff661302700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c16ccc0 con 0x7ff65c0cd1b0 2024-08-17T02:27:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff660b01700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff660b01700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:51942/0 (socket says 172.21.15.155:51942) 2024-08-17T02:27:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff65b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52346/0 (socket says 172.21.15.155:52346) 2024-08-17T02:27:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff660b01700 1 -- 172.21.15.155:0/197929343 learned_addr learned my addr 172.21.15.155:0/197929343 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.836+0000 7ff65bfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c16c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 -- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 msgr2=0x7ff65c16c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c16c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 -- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 msgr2=0x7ff65c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 -- 172.21.15.155:0/197929343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c009420 con 0x7ff65c153320 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff660b01700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff65b7fe700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c560 tx=0x7ff644007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644005b30 con 0x7ff65c153320 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644005cb0 con 0x7ff65c153320 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644007320 con 0x7ff65c153320 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff654009a20 con 0x7ff65c153320 2024-08-17T02:27:47.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c16d280 con 0x7ff65c153320 2024-08-17T02:27:47.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff64401b3b0 con 0x7ff65c153320 2024-08-17T02:27:47.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.840+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0638f0 con 0x7ff65c153320 2024-08-17T02:27:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.844+0000 7ff653fff700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 0x7ff63c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.844+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff64407bf10 con 0x7ff65c153320 2024-08-17T02:27:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.844+0000 7ff65bfff700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 0x7ff63c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.844+0000 7ff65bfff700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 0x7ff63c062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009f20 tx=0x7ff64c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:47.848+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff64404c360 con 0x7ff65c153320 2024-08-17T02:27:48.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.016+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff65c0cde20 con 0x7ff65c153320 2024-08-17T02:27:48.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.016+0000 7ff653fff700 1 -- 172.21.15.155:0/197929343 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff644017090 con 0x7ff65c153320 2024-08-17T02:27:48.020 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:48.020 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 msgr2=0x7ff63c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 0x7ff63c062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009f20 tx=0x7ff64c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 msgr2=0x7ff65c0b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c560 tx=0x7ff644007d50 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 shutdown_connections 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff63c060860 0x7ff63c062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff65c15a190 0x7ff65c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff65c153320 0x7ff65c0b5340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 --2- 172.21.15.155:0/197929343 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff65c0cd1b0 0x7ff65c16c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 >> 172.21.15.155:0/197929343 conn(0x7ff65c0d00a0 msgr2=0x7ff65c159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 shutdown_connections 2024-08-17T02:27:48.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.020+0000 7ff661302700 1 -- 172.21.15.155:0/197929343 wait complete. 2024-08-17T02:27:48.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:48.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:48.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 Processor -- start 2024-08-17T02:27:48.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 -- start start 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9cac0b14a0 0x7f9cac157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac06e010 con 0x7f9cac1574f0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac157fb0 con 0x7f9cac1514d0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cb0ca4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac158290 con 0x7f9cac0b14a0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cabfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9cac0b14a0 0x7f9cac157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9caaffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9cac1574f0 0x7f9cac0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47992/0 (socket says 172.21.15.155:47992) 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9caaffd700 1 -- 172.21.15.155:0/135681423 learned_addr learned my addr 172.21.15.155:0/135681423 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cabfff700 1 -- 172.21.15.155:0/135681423 >> v1:172.21.15.189:6789/0 conn(0x7f9cac1514d0 legacy=0x7f9cac06ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cabfff700 1 -- 172.21.15.155:0/135681423 >> v1:172.21.15.155:6789/0 conn(0x7f9cac1574f0 legacy=0x7f9cac0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cabfff700 1 -- 172.21.15.155:0/135681423 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac06e260 con 0x7f9cac0b14a0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.144+0000 7f9cabfff700 1 --2- 172.21.15.155:0/135681423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac157970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e60 tx=0x7f9ca4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102633a2b77766b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9caa7fc700 1 -- 172.21.15.155:0/135681423 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400e070 con 0x7f9cac0b14a0 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9caa7fc700 1 -- 172.21.15.155:0/135681423 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400bc30 con 0x7f9cac0b14a0 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9caa7fc700 1 -- 172.21.15.155:0/135681423 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4012430 con 0x7f9cac0b14a0 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/135681423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 msgr2=0x7f9cac157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/135681423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac157970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e60 tx=0x7f9ca4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/135681423 shutdown_connections 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/135681423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac157970 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/135681423 >> 172.21.15.155:0/135681423 conn(0x7f9cac0678a0 msgr2=0x7f9cac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/135681423 shutdown_connections 2024-08-17T02:27:48.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/135681423 wait complete. 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 Processor -- start 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- start start 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cac1514d0 0x7f9cac0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cac1574f0 0x7f9cac0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0afd00 con 0x7f9cac0b14a0 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0af0f0 con 0x7f9cac1574f0 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cb0ca4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0af3d0 con 0x7f9cac1514d0 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cab7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cab7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52370/0 (socket says 172.21.15.155:52370) 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cab7fe700 1 -- 172.21.15.155:0/1258834024 learned_addr learned my addr 172.21.15.155:0/1258834024 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9cabfff700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cac1574f0 0x7f9cac0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.148+0000 7f9caaffd700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cac1514d0 0x7f9cac0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 -- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cac1514d0 msgr2=0x7f9cac0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cac1514d0 0x7f9cac0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 -- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cac1574f0 msgr2=0x7f9cac0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cac1574f0 0x7f9cac0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 -- 172.21.15.155:0/1258834024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009a20 con 0x7f9cac0b14a0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cab7fe700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c790 tx=0x7f9c9c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011590 con 0x7f9cac0b14a0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c011710 con 0x7f9cac0b14a0 2024-08-17T02:27:48.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac0af6b0 con 0x7f9cac0b14a0 2024-08-17T02:27:48.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011ad0 con 0x7f9cac0b14a0 2024-08-17T02:27:48.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac152a90 con 0x7f9cac0b14a0 2024-08-17T02:27:48.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac064330 con 0x7f9cac0b14a0 2024-08-17T02:27:48.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.152+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c9c01b3b0 con 0x7f9cac0b14a0 2024-08-17T02:27:48.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.156+0000 7f9ca37fe700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 0x7f9c8c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.156+0000 7f9caaffd700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 0x7f9c8c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.156+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c9c07bf30 con 0x7f9cac0b14a0 2024-08-17T02:27:48.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.156+0000 7f9caaffd700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 0x7f9c8c062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cac16c2c0 tx=0x7f9c94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.160+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c9c04c380 con 0x7f9cac0b14a0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.328+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cac06ebb0 con 0x7f9cac0b14a0 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.328+0000 7f9ca37fe700 1 -- 172.21.15.155:0/1258834024 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c9c017020 con 0x7f9cac0b14a0 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 msgr2=0x7f9c8c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 0x7f9c8c062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cac16c2c0 tx=0x7f9c94009040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 msgr2=0x7f9cac152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c790 tx=0x7f9c9c007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 shutdown_connections 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9c8c060890 0x7f9c8c062d40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cac1574f0 0x7f9cac0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9cac1514d0 0x7f9cac0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 --2- 172.21.15.155:0/1258834024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cac0b14a0 0x7f9cac152550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 >> 172.21.15.155:0/1258834024 conn(0x7f9cac0678a0 msgr2=0x7f9cac1560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 shutdown_connections 2024-08-17T02:27:48.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.332+0000 7f9cb0ca4700 1 -- 172.21.15.155:0/1258834024 wait complete. 2024-08-17T02:27:48.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:48.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.452+0000 7fede206f700 1 Processor -- start 2024-08-17T02:27:48.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.452+0000 7fede206f700 1 -- start start 2024-08-17T02:27:48.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 0x7feddc0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7feddc0ae6f0 0x7feddc0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0cc440 con 0x7feddc0cbab0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0c3e30 con 0x7feddc0ae6f0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c4110 con 0x7feddc140910 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede086c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7feddc0cbab0 0x7feddc0c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48008/0 (socket says 172.21.15.155:48008) 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede086c700 1 -- 172.21.15.155:0/3039778102 learned_addr learned my addr 172.21.15.155:0/3039778102 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede186e700 1 --2- 172.21.15.155:0/3039778102 >> v2:172.21.15.189:3300/0 conn(0x7feddc0ae6f0 0x7feddc0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 --2- 172.21.15.155:0/3039778102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 0x7feddc0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fedd3fff700 1 -- 172.21.15.155:0/3039778102 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303321504 0 0) 0x7feddc0cc440 con 0x7feddc0cbab0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fedd3fff700 1 -- 172.21.15.155:0/3039778102 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc8003570 con 0x7feddc0cbab0 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 -- 172.21.15.155:0/3039778102 >> v2:172.21.15.189:3300/0 conn(0x7feddc0ae6f0 msgr2=0x7feddc0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 --2- 172.21.15.155:0/3039778102 >> v2:172.21.15.189:3300/0 conn(0x7feddc0ae6f0 0x7feddc0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 -- 172.21.15.155:0/3039778102 >> v1:172.21.15.155:6789/0 conn(0x7feddc0cbab0 legacy=0x7feddc0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 -- 172.21.15.155:0/3039778102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0c43f0 con 0x7feddc140910 2024-08-17T02:27:48.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede106d700 1 --2- 172.21.15.155:0/3039778102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 0x7feddc0c8520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedd80098e0 tx=0x7fedd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5fa9bf91844ecf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fedd3fff700 1 -- 172.21.15.155:0/3039778102 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8011630 con 0x7feddc140910 2024-08-17T02:27:48.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fedd3fff700 1 -- 172.21.15.155:0/3039778102 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8011790 con 0x7feddc140910 2024-08-17T02:27:48.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fedd3fff700 1 -- 172.21.15.155:0/3039778102 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8011b10 con 0x7feddc140910 2024-08-17T02:27:48.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- 172.21.15.155:0/3039778102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 msgr2=0x7feddc0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 --2- 172.21.15.155:0/3039778102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 0x7feddc0c8520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedd80098e0 tx=0x7fedd80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- 172.21.15.155:0/3039778102 shutdown_connections 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 --2- 172.21.15.155:0/3039778102 >> v2:172.21.15.189:3300/0 conn(0x7feddc0ae6f0 0x7feddc0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 --2- 172.21.15.155:0/3039778102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc140910 0x7feddc0c8520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- 172.21.15.155:0/3039778102 >> 172.21.15.155:0/3039778102 conn(0x7feddc0cdee0 msgr2=0x7feddc0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- 172.21.15.155:0/3039778102 shutdown_connections 2024-08-17T02:27:48.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.456+0000 7fede206f700 1 -- 172.21.15.155:0/3039778102 wait complete. 2024-08-17T02:27:48.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 Processor -- start 2024-08-17T02:27:48.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 -- start start 2024-08-17T02:27:48.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 0x7feddc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 0x7feddc068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc13e260 con 0x7feddc0ae6f0 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc06c480 con 0x7feddc140910 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede206f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc158cc0 con 0x7feddc0cbab0 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52382/0 (socket says 172.21.15.155:52382) 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 -- 172.21.15.155:0/1907196420 learned_addr learned my addr 172.21.15.155:0/1907196420 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede186e700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 0x7feddc068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede086c700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 0x7feddc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 -- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 msgr2=0x7feddc0687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 0x7feddc0687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 -- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 msgr2=0x7feddc068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 0x7feddc068ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede106d700 1 -- 172.21.15.155:0/1907196420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8009420 con 0x7feddc0ae6f0 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede186e700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 0x7feddc068ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.460+0000 7fede086c700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 0x7feddc0687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede106d700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feddc0c4250 tx=0x7fedd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8011b10 con 0x7feddc0ae6f0 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8000cc0 con 0x7feddc0ae6f0 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc158fa0 con 0x7feddc0ae6f0 2024-08-17T02:27:48.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd801a680 con 0x7feddc0ae6f0 2024-08-17T02:27:48.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc06b650 con 0x7feddc0ae6f0 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0cb530 con 0x7feddc0ae6f0 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fedd801aa70 con 0x7feddc0ae6f0 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 0x7fedc0062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedd807e7d0 con 0x7feddc0ae6f0 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede086c700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 0x7fedc0062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.464+0000 7fede086c700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 0x7fedc0062de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fedcc007fd0 tx=0x7fedcc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.476+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fedd804eca0 con 0x7feddc0ae6f0 2024-08-17T02:27:48.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.636+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feddc0708e0 con 0x7feddc0ae6f0 2024-08-17T02:27:48.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fedd17fa700 1 -- 172.21.15.155:0/1907196420 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedd8015020 con 0x7feddc0ae6f0 2024-08-17T02:27:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:48.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 msgr2=0x7fedc0062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 0x7fedc0062de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fedcc007fd0 tx=0x7fedcc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 msgr2=0x7feddc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feddc0c4250 tx=0x7fedd8017000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 shutdown_connections 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fedc0060930 0x7fedc0062de0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feddc140910 0x7feddc068ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7feddc0cbab0 0x7feddc0687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 --2- 172.21.15.155:0/1907196420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feddc0ae6f0 0x7feddc15b090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 >> 172.21.15.155:0/1907196420 conn(0x7feddc0cdee0 msgr2=0x7feddc0ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 shutdown_connections 2024-08-17T02:27:48.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.640+0000 7fede206f700 1 -- 172.21.15.155:0/1907196420 wait complete. 2024-08-17T02:27:48.656 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:48.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 Processor -- start 2024-08-17T02:27:48.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 -- start start 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1141590b0 0x7fb114066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1140ce210 con 0x7fb1140cd2b0 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11415dc20 con 0x7fb114159480 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb118a2b700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1140cba00 con 0x7fb1141590b0 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb1140cd2b0 0x7fb11415d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48014/0 (socket says 172.21.15.155:48014) 2024-08-17T02:27:48.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 -- 172.21.15.155:0/1185205523 learned_addr learned my addr 172.21.15.155:0/1185205523 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:48.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1137fe700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1141590b0 0x7fb114066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602066479 0 0) 0x7fb1140ce210 con 0x7fb1140cd2b0 2024-08-17T02:27:48.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc003570 con 0x7fb1140cd2b0 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501080443 0 0) 0x7fb11415dc20 con 0x7fb114159480 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1140ce210 con 0x7fb114159480 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616876529 0 0) 0x7fb0fc003570 con 0x7fb1140cd2b0 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1141590b0 msgr2=0x7fb114066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1141590b0 0x7fb114066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 >> v1:172.21.15.189:6789/0 conn(0x7fb114159480 legacy=0x7fb11415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140cb440 con 0x7fb1140cd2b0 2024-08-17T02:27:48.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fb10c0017f0 con 0x7fb1140cd2b0 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 >> v1:172.21.15.155:6789/0 conn(0x7fb1140cd2b0 legacy=0x7fb11415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc003c20 0x7fb0fc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc004810 0x7fb0fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc0051c0 0x7fb0fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00bff0 con 0x7fb0fc0051c0 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00c160 con 0x7fb0fc004810 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00c320 con 0x7fb0fc003c20 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc0051c0 0x7fb0fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb112ffd700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc004810 0x7fb0fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1137fe700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc003c20 0x7fb0fc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 -- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc003c20 msgr2=0x7fb0fc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc003c20 0x7fb0fc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 -- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc004810 msgr2=0x7fb0fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc004810 0x7fb0fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 -- 172.21.15.155:0/1185205523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc003570 con 0x7fb0fc0051c0 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb112ffd700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc004810 0x7fb0fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1137fe700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc003c20 0x7fb0fc004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb113fff700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc0051c0 0x7fb0fc00ba60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00a8f0 tx=0x7fb10c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddf30a1b86a16d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0070d0 con 0x7fb0fc0051c0 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c007250 con 0x7fb0fc0051c0 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.760+0000 7fb1127fc700 1 -- 172.21.15.155:0/1185205523 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c007610 con 0x7fb0fc0051c0 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- 172.21.15.155:0/1185205523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc0051c0 msgr2=0x7fb0fc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 --2- 172.21.15.155:0/1185205523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc0051c0 0x7fb0fc00ba60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00a8f0 tx=0x7fb10c002190 comp rx=0 tx=0).stop 2024-08-17T02:27:48.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb113fff700 1 -- 172.21.15.155:0/1185205523 reap_dead start 2024-08-17T02:27:48.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- 172.21.15.155:0/1185205523 shutdown_connections 2024-08-17T02:27:48.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- 172.21.15.155:0/1185205523 >> 172.21.15.155:0/1185205523 conn(0x7fb1140d0b90 msgr2=0x7fb1140ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- 172.21.15.155:0/1185205523 shutdown_connections 2024-08-17T02:27:48.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- 172.21.15.155:0/1185205523 wait complete. 2024-08-17T02:27:48.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 Processor -- start 2024-08-17T02:27:48.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- start start 2024-08-17T02:27:48.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb11414fbc0 0x7fb114151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1140b52f0 0x7fb114153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1141527a0 con 0x7fb11414ff90 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb114152a80 con 0x7fb11414fbc0 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb118a2b700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb114152d60 con 0x7fb1140b52f0 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb113fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb113fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52410/0 (socket says 172.21.15.155:52410) 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb113fff700 1 -- 172.21.15.155:0/683205907 learned_addr learned my addr 172.21.15.155:0/683205907 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.764+0000 7fb1137fe700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb11414fbc0 0x7fb114151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb112ffd700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1140b52f0 0x7fb114153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 -- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1140b52f0 msgr2=0x7fb114153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1140b52f0 0x7fb114153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 -- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb11414fbc0 msgr2=0x7fb114151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb11414fbc0 0x7fb114151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 -- 172.21.15.155:0/683205907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114153040 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb113fff700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb10c012000 tx=0x7fb10c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c023070 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c004bb0 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1140b2f00 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c000fb0 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb114152490 con 0x7fb11414ff90 2024-08-17T02:27:48.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.768+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb114064330 con 0x7fb11414ff90 2024-08-17T02:27:48.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.772+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb10c01e430 con 0x7fb11414ff90 2024-08-17T02:27:48.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.772+0000 7fb0fb7fe700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 0x7fb100062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.772+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb10c07e1c0 con 0x7fb11414ff90 2024-08-17T02:27:48.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.772+0000 7fb1137fe700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 0x7fb100062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.772+0000 7fb1137fe700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 0x7fb100062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb104009170 tx=0x7fb104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.780+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb10c04e610 con 0x7fb11414ff90 2024-08-17T02:27:48.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.944+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb114070cf0 con 0x7fb11414ff90 2024-08-17T02:27:48.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.944+0000 7fb0fb7fe700 1 -- 172.21.15.155:0/683205907 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb10c051c30 con 0x7fb11414ff90 2024-08-17T02:27:48.950 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 msgr2=0x7fb100062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 0x7fb100062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb104009170 tx=0x7fb104008040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 msgr2=0x7fb114153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb10c012000 tx=0x7fb10c016000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 shutdown_connections 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb100060860 0x7fb100062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb11414ff90 0x7fb114153a50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1140b52f0 0x7fb114153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 --2- 172.21.15.155:0/683205907 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb11414fbc0 0x7fb114151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 >> 172.21.15.155:0/683205907 conn(0x7fb1140d0b90 msgr2=0x7fb1141503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 shutdown_connections 2024-08-17T02:27:48.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:48.948+0000 7fb118a2b700 1 -- 172.21.15.155:0/683205907 wait complete. 2024-08-17T02:27:48.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:49.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 Processor -- start 2024-08-17T02:27:49.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 -- start start 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6780158e80 0x7f6780159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 0x7f67800cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b2e70 con 0x7f67800cf240 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b39f0 con 0x7f6780158e80 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6786599700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780159790 con 0x7f6780067510 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6784d96700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f67800cf240 0x7f6780066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48022/0 (socket says 172.21.15.155:48022) 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6784d96700 1 -- 172.21.15.155:0/3365397514 learned_addr learned my addr 172.21.15.155:0/3365397514 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6785597700 1 --2- 172.21.15.155:0/3365397514 >> v2:172.21.15.189:3300/0 conn(0x7f6780158e80 0x7f6780159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6785d98700 1 --2- 172.21.15.155:0/3365397514 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 0x7f67800cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6777fff700 1 -- 172.21.15.155:0/3365397514 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994271745 0 0) 0x7f67800b2e70 con 0x7f67800cf240 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.072+0000 7f6777fff700 1 -- 172.21.15.155:0/3365397514 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676c003570 con 0x7f67800cf240 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6785d98700 1 -- 172.21.15.155:0/3365397514 >> v2:172.21.15.189:3300/0 conn(0x7f6780158e80 msgr2=0x7f6780159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6785d98700 1 --2- 172.21.15.155:0/3365397514 >> v2:172.21.15.189:3300/0 conn(0x7f6780158e80 0x7f6780159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6785d98700 1 -- 172.21.15.155:0/3365397514 >> v1:172.21.15.155:6789/0 conn(0x7f67800cf240 legacy=0x7f6780066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6785d98700 1 -- 172.21.15.155:0/3365397514 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800b30c0 con 0x7f6780067510 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6785d98700 1 --2- 172.21.15.155:0/3365397514 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 0x7f67800cf6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6778009e60 tx=0x7f6778009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c85aeba670fb962 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6777fff700 1 -- 172.21.15.155:0/3365397514 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800e070 con 0x7f6780067510 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6777fff700 1 -- 172.21.15.155:0/3365397514 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677800bab0 con 0x7f6780067510 2024-08-17T02:27:49.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6777fff700 1 -- 172.21.15.155:0/3365397514 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800be70 con 0x7f6780067510 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- 172.21.15.155:0/3365397514 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 msgr2=0x7f67800cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 --2- 172.21.15.155:0/3365397514 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 0x7f67800cf6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6778009e60 tx=0x7f6778009780 comp rx=0 tx=0).stop 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- 172.21.15.155:0/3365397514 shutdown_connections 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 --2- 172.21.15.155:0/3365397514 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6780067510 0x7f67800cf6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 --2- 172.21.15.155:0/3365397514 >> v2:172.21.15.189:3300/0 conn(0x7f6780158e80 0x7f6780159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- 172.21.15.155:0/3365397514 >> 172.21.15.155:0/3365397514 conn(0x7f678006a3d0 msgr2=0x7f67800b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- 172.21.15.155:0/3365397514 shutdown_connections 2024-08-17T02:27:49.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- 172.21.15.155:0/3365397514 wait complete. 2024-08-17T02:27:49.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 Processor -- start 2024-08-17T02:27:49.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.076+0000 7f6786599700 1 -- start start 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6780067510 0x7f67801439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 0x7f678016c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678016d7e0 con 0x7f6780158e80 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800ca970 con 0x7f6780067510 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678016d220 con 0x7f67800cf240 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52422/0 (socket says 172.21.15.155:52422) 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 -- 172.21.15.155:0/3989836838 learned_addr learned my addr 172.21.15.155:0/3989836838 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785597700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6780067510 0x7f67801439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6784d96700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 0x7f678016c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 -- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 msgr2=0x7f678016c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 0x7f678016c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 -- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6780067510 msgr2=0x7f67801439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6780067510 0x7f67801439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 -- 172.21.15.155:0/3989836838 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778009a20 con 0x7f6780158e80 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6784d96700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 0x7f678016c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6785d98700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6778013000 tx=0x7f6778019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778027470 con 0x7f6780158e80 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67780275f0 con 0x7f6780158e80 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678016d500 con 0x7f6780158e80 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780279b0 con 0x7f6780158e80 2024-08-17T02:27:49.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800caef0 con 0x7f6780158e80 2024-08-17T02:27:49.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.080+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67800cb110 con 0x7f6780158e80 2024-08-17T02:27:49.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.084+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6778024070 con 0x7f6780158e80 2024-08-17T02:27:49.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.084+0000 7f67757fa700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 0x7f6764062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.084+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f677807f440 con 0x7f6780158e80 2024-08-17T02:27:49.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.084+0000 7f6785597700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 0x7f6764062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.084+0000 7f6785597700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 0x7f6764062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6770009d10 tx=0x7f67700091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.088+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f677804f890 con 0x7f6780158e80 2024-08-17T02:27:49.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.252+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67800638f0 con 0x7f6780158e80 2024-08-17T02:27:49.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f67757fa700 1 -- 172.21.15.155:0/3989836838 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6778052eb0 con 0x7f6780158e80 2024-08-17T02:27:49.258 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:49.258 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 msgr2=0x7f6764062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 0x7f6764062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6770009d10 tx=0x7f67700091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 msgr2=0x7f6780156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6778013000 tx=0x7f6778019000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 shutdown_connections 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6764060860 0x7f6764062d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6780158e80 0x7f6780156430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f67800cf240 0x7f678016c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 --2- 172.21.15.155:0/3989836838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6780067510 0x7f67801439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 >> 172.21.15.155:0/3989836838 conn(0x7f678006a3d0 msgr2=0x7f6780159900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 shutdown_connections 2024-08-17T02:27:49.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.256+0000 7f6786599700 1 -- 172.21.15.155:0/3989836838 wait complete. 2024-08-17T02:27:49.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:49.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:49.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.384+0000 7f629bfff700 1 Processor -- start 2024-08-17T02:27:49.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.384+0000 7f629bfff700 1 -- start start 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 0x7f629c067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f629c158cc0 0x7f629c1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0cf670 con 0x7f629c0cfb00 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0cea60 con 0x7f629c158cc0 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0ced40 con 0x7f629c067030 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f629c158cc0 0x7f629c1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f629c158cc0 0x7f629c1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52432/0 (socket says 172.21.15.155:52432) 2024-08-17T02:27:49.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 -- 172.21.15.155:0/1307075423 learned_addr learned my addr 172.21.15.155:0/1307075423 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629affd700 1 --2- 172.21.15.155:0/1307075423 >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 0x7f629c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 -- 172.21.15.155:0/1307075423 >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 msgr2=0x7f629c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 --2- 172.21.15.155:0/1307075423 >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 0x7f629c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 -- 172.21.15.155:0/1307075423 >> v1:172.21.15.189:6789/0 conn(0x7f629c0cfb00 legacy=0x7f629c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 -- 172.21.15.155:0/1307075423 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0cf020 con 0x7f629c158cc0 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629affd700 1 --2- 172.21.15.155:0/1307075423 >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 0x7f629c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629b7fe700 1 --2- 172.21.15.155:0/1307075423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c158cc0 0x7f629c1590d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f629c0d1070 tx=0x7f6294009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c2f2b1e08d008b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f6299ffb700 1 -- 172.21.15.155:0/1307075423 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400e070 con 0x7f629c158cc0 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f6299ffb700 1 -- 172.21.15.155:0/1307075423 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400ba50 con 0x7f629c158cc0 2024-08-17T02:27:49.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f6299ffb700 1 -- 172.21.15.155:0/1307075423 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940092e0 con 0x7f629c158cc0 2024-08-17T02:27:49.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- 172.21.15.155:0/1307075423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c158cc0 msgr2=0x7f629c1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 --2- 172.21.15.155:0/1307075423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c158cc0 0x7f629c1590d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f629c0d1070 tx=0x7f6294009840 comp rx=0 tx=0).stop 2024-08-17T02:27:49.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- 172.21.15.155:0/1307075423 shutdown_connections 2024-08-17T02:27:49.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 --2- 172.21.15.155:0/1307075423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c158cc0 0x7f629c1590d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 --2- 172.21.15.155:0/1307075423 >> v2:172.21.15.189:3300/0 conn(0x7f629c067030 0x7f629c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- 172.21.15.155:0/1307075423 >> 172.21.15.155:0/1307075423 conn(0x7f629c0d0b50 msgr2=0x7f629c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- 172.21.15.155:0/1307075423 shutdown_connections 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- 172.21.15.155:0/1307075423 wait complete. 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 Processor -- start 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.388+0000 7f629bfff700 1 -- start start 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 0x7f629c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c158cc0 0x7f629c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0b5310 con 0x7f629c0cfb00 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1595e0 con 0x7f629c158cc0 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1598c0 con 0x7f629c067030 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52434/0 (socket says 172.21.15.155:52434) 2024-08-17T02:27:49.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 -- 172.21.15.155:0/3426293872 learned_addr learned my addr 172.21.15.155:0/3426293872 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629b7fe700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c158cc0 0x7f629c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629affd700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 0x7f629c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 -- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 msgr2=0x7f629c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 0x7f629c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 -- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c158cc0 msgr2=0x7f629c14f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c158cc0 0x7f629c14f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 -- 172.21.15.155:0/3426293872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294009ae0 con 0x7f629c0cfb00 2024-08-17T02:27:49.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629affd700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 0x7f629c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629a7fc700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c590 tx=0x7f628c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c011590 con 0x7f629c0cfb00 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c011710 con 0x7f629c0cfb00 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c011ad0 con 0x7f629c0cfb00 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c159ba0 con 0x7f629c0cfb00 2024-08-17T02:27:49.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c155a30 con 0x7f629c0cfb00 2024-08-17T02:27:49.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.392+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c0638f0 con 0x7f629c0cfb00 2024-08-17T02:27:49.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.396+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f628c01b3b0 con 0x7f629c0cfb00 2024-08-17T02:27:49.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.396+0000 7f6282ffd700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 0x7f6288062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.396+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f628c07c140 con 0x7f629c0cfb00 2024-08-17T02:27:49.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.396+0000 7f629affd700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 0x7f6288062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.396+0000 7f629affd700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 0x7f6288062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6290006f00 tx=0x7f6290008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.404+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f628c04c590 con 0x7f629c0cfb00 2024-08-17T02:27:49.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.568+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f629c152fd0 con 0x7f629c0cfb00 2024-08-17T02:27:49.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.568+0000 7f6282ffd700 1 -- 172.21.15.155:0/3426293872 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f628c0170a0 con 0x7f629c0cfb00 2024-08-17T02:27:49.573 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 msgr2=0x7f6288062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 0x7f6288062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6290006f00 tx=0x7f6290008040 comp rx=0 tx=0).stop 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 msgr2=0x7f629c15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c590 tx=0x7f628c00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 shutdown_connections 2024-08-17T02:27:49.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6288060860 0x7f6288062d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c158cc0 0x7f629c14f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f629c0cfb00 0x7f629c15abe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 --2- 172.21.15.155:0/3426293872 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f629c067030 0x7f629c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 >> 172.21.15.155:0/3426293872 conn(0x7f629c0d0b50 msgr2=0x7f629c1534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 shutdown_connections 2024-08-17T02:27:49.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.572+0000 7f629bfff700 1 -- 172.21.15.155:0/3426293872 wait complete. 2024-08-17T02:27:49.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:49.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 Processor -- start 2024-08-17T02:27:49.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 -- start start 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 0x7f1398067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13980cb5c0 0x7f1398158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980cf670 con 0x7f13980cb5c0 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980cea60 con 0x7f1398067030 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139e19f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980ced40 con 0x7f13980cfb00 2024-08-17T02:27:49.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13980cb5c0 0x7f1398158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139c99c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d19d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 0x7f1398067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139c99c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:53542/0 (socket says 172.21.15.155:53542) 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139c99c700 1 -- 172.21.15.155:0/958218554 learned_addr learned my addr 172.21.15.155:0/958218554 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13980cb5c0 0x7f1398158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52444/0 (socket says 172.21.15.155:52444) 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 -- 172.21.15.155:0/958218554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 msgr2=0x7f13980cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 -- 172.21.15.155:0/958218554 >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 msgr2=0x7f1398067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 --2- 172.21.15.155:0/958218554 >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 0x7f1398067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 -- 172.21.15.155:0/958218554 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980cf020 con 0x7f13980cb5c0 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d19d700 1 --2- 172.21.15.155:0/958218554 >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 0x7f1398067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:49.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139c99c700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f139d99e700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13980cb5c0 0x7f1398158cc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13980d1070 tx=0x7f1390009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfddca4f34a86b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f138ffff700 1 -- 172.21.15.155:0/958218554 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000e070 con 0x7f13980cb5c0 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f138ffff700 1 -- 172.21.15.155:0/958218554 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000bab0 con 0x7f13980cb5c0 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.692+0000 7f138ffff700 1 -- 172.21.15.155:0/958218554 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000be70 con 0x7f13980cb5c0 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- 172.21.15.155:0/958218554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13980cb5c0 msgr2=0x7f1398158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13980cb5c0 0x7f1398158cc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13980d1070 tx=0x7f1390009780 comp rx=0 tx=0).stop 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- 172.21.15.155:0/958218554 shutdown_connections 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13980cb5c0 0x7f1398158cc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- 172.21.15.155:0/958218554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cfb00 0x7f13980cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- 172.21.15.155:0/958218554 >> v2:172.21.15.189:3300/0 conn(0x7f1398067030 0x7f1398067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- 172.21.15.155:0/958218554 >> 172.21.15.155:0/958218554 conn(0x7f13980d0b50 msgr2=0x7f13980ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- 172.21.15.155:0/958218554 shutdown_connections 2024-08-17T02:27:49.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- 172.21.15.155:0/958218554 wait complete. 2024-08-17T02:27:49.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 Processor -- start 2024-08-17T02:27:49.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- start start 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cb5c0 0x7f1398143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 0x7f1398155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398157010 con 0x7f1398067030 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398156400 con 0x7f13980cfb00 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.696+0000 7f139e19f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13981566e0 con 0x7f13980cb5c0 2024-08-17T02:27:49.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52454/0 (socket says 172.21.15.155:52454) 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 -- 172.21.15.155:0/1015380785 learned_addr learned my addr 172.21.15.155:0/1015380785 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139c99c700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cb5c0 0x7f1398143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d99e700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 0x7f1398155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 -- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cb5c0 msgr2=0x7f1398143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cb5c0 0x7f1398143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 -- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 msgr2=0x7f1398155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 0x7f1398155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 -- 172.21.15.155:0/1015380785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009420 con 0x7f1398067030 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d99e700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 0x7f1398155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139d19d700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139400ec80 tx=0x7f13940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400c8f0 con 0x7f1398067030 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400ca50 con 0x7f1398067030 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400cdd0 con 0x7f1398067030 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880094f0 con 0x7f1398067030 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1390009a20 con 0x7f1398067030 2024-08-17T02:27:49.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.700+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13980638f0 con 0x7f1398067030 2024-08-17T02:27:49.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.704+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1394013680 con 0x7f1398067030 2024-08-17T02:27:49.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.704+0000 7f138d7fa700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 0x7f137c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.704+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f139407ce90 con 0x7f1398067030 2024-08-17T02:27:49.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.704+0000 7f139c99c700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 0x7f137c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.704+0000 7f139c99c700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 0x7f137c062d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13980b57d0 tx=0x7f1388009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.708+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f139404d2e0 con 0x7f1398067030 2024-08-17T02:27:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.868+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13980b0900 con 0x7f1398067030 2024-08-17T02:27:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.868+0000 7f138d7fa700 1 -- 172.21.15.155:0/1015380785 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1394050900 con 0x7f1398067030 2024-08-17T02:27:49.873 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 msgr2=0x7f137c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 0x7f137c062d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13980b57d0 tx=0x7f1388009250 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 msgr2=0x7f13980b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139400ec80 tx=0x7f13940091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 shutdown_connections 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f137c060890 0x7f137c062d40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13980cfb00 0x7f1398155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13980cb5c0 0x7f1398143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 --2- 172.21.15.155:0/1015380785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1398067030 0x7f13980b5290 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 >> 172.21.15.155:0/1015380785 conn(0x7f13980d0b50 msgr2=0x7f13980b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 shutdown_connections 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.872+0000 7f139e19f700 1 -- 172.21.15.155:0/1015380785 wait complete. 2024-08-17T02:27:49.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:50.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 Processor -- start 2024-08-17T02:27:50.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 -- start start 2024-08-17T02:27:50.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa92806e720 0x7fa9280aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280b0810 con 0x7fa92813f680 2024-08-17T02:27:50.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280afc70 con 0x7fa92813fa50 2024-08-17T02:27:50.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa927fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9280af060 con 0x7fa92806e720 2024-08-17T02:27:50.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:49.996+0000 7fa926ffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa92813f680 0x7fa9280b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48028/0 (socket says 172.21.15.155:48028) 2024-08-17T02:27:50.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa926ffd700 1 -- 172.21.15.155:0/2051863624 learned_addr learned my addr 172.21.15.155:0/2051863624 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:50.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa9277fe700 1 --2- 172.21.15.155:0/2051863624 >> v2:172.21.15.189:3300/0 conn(0x7fa92806e720 0x7fa9280aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86681910 0 0) 0x7fa9280b0810 con 0x7fa92813f680 2024-08-17T02:27:50.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa914003570 con 0x7fa92813f680 2024-08-17T02:27:50.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062288406 0 0) 0x7fa9280afc70 con 0x7fa92813fa50 2024-08-17T02:27:50.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9280b0810 con 0x7fa92813fa50 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104029627 0 0) 0x7fa914003570 con 0x7fa92813f680 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa9277fe700 1 -- 172.21.15.155:0/2051863624 >> v1:172.21.15.189:6789/0 conn(0x7fa92813fa50 legacy=0x7fa92806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa9277fe700 1 -- 172.21.15.155:0/2051863624 >> v1:172.21.15.155:6789/0 conn(0x7fa92813f680 legacy=0x7fa9280b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa9277fe700 1 -- 172.21.15.155:0/2051863624 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280af340 con 0x7fa92806e720 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa9277fe700 1 --2- 172.21.15.155:0/2051863624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92806e720 0x7fa9280aea80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f15476dfff1ed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000e070 con 0x7fa92806e720 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000b7a0 con 0x7fa92806e720 2024-08-17T02:27:50.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa925ffb700 1 -- 172.21.15.155:0/2051863624 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918001470 con 0x7fa92806e720 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 -- 172.21.15.155:0/2051863624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92806e720 msgr2=0x7fa9280aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 --2- 172.21.15.155:0/2051863624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92806e720 0x7fa9280aea80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa920009e60 tx=0x7fa920009780 comp rx=0 tx=0).stop 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 -- 172.21.15.155:0/2051863624 shutdown_connections 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 --2- 172.21.15.155:0/2051863624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92806e720 0x7fa9280aea80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 -- 172.21.15.155:0/2051863624 >> 172.21.15.155:0/2051863624 conn(0x7fa9280678a0 msgr2=0x7fa928067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 -- 172.21.15.155:0/2051863624 shutdown_connections 2024-08-17T02:27:50.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.000+0000 7fa927fff700 1 -- 172.21.15.155:0/2051863624 wait complete. 2024-08-17T02:27:50.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 Processor -- start 2024-08-17T02:27:50.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- start start 2024-08-17T02:27:50.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92813f680 0x7fa928157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 0x7fa9280a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa928158ec0 con 0x7fa92806e720 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280a6930 con 0x7fa92813f680 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa928158900 con 0x7fa92813fa50 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52456/0 (socket says 172.21.15.155:52456) 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 -- 172.21.15.155:0/829427662 learned_addr learned my addr 172.21.15.155:0/829427662 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa9267fc700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92813f680 0x7fa928157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa9277fe700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 0x7fa9280a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 -- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 msgr2=0x7fa9280a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 0x7fa9280a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 -- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92813f680 msgr2=0x7fa928157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92813f680 0x7fa928157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 -- 172.21.15.155:0/829427662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009a20 con 0x7fa92806e720 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa9277fe700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 0x7fa9280a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa926ffd700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cb90 tx=0x7fa918001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918007e90 con 0x7fa92806e720 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa918007360 con 0x7fa92806e720 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa928158be0 con 0x7fa92806e720 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918004830 con 0x7fa92806e720 2024-08-17T02:27:50.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.004+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9281551c0 con 0x7fa92806e720 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa928064330 con 0x7fa92806e720 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa918004ba0 con 0x7fa92806e720 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa91effd700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 0x7fa908062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa91807c370 con 0x7fa92806e720 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa9267fc700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 0x7fa908062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.008+0000 7fa9267fc700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 0x7fa908062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9280a87a0 tx=0x7fa910007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.016+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa91804c840 con 0x7fa92806e720 2024-08-17T02:27:50.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.176+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa92806ed70 con 0x7fa92806e720 2024-08-17T02:27:50.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.176+0000 7fa91effd700 1 -- 172.21.15.155:0/829427662 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa91804fe60 con 0x7fa92806e720 2024-08-17T02:27:50.180 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 msgr2=0x7fa908062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 0x7fa908062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9280a87a0 tx=0x7fa910007d50 comp rx=0 tx=0).stop 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 msgr2=0x7fa928154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cb90 tx=0x7fa918001ad0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 shutdown_connections 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa908060860 0x7fa908062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa92813fa50 0x7fa9280a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92813f680 0x7fa928157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 --2- 172.21.15.155:0/829427662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa92806e720 0x7fa928154c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 >> 172.21.15.155:0/829427662 conn(0x7fa9280678a0 msgr2=0x7fa9280b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 shutdown_connections 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.180+0000 7fa927fff700 1 -- 172.21.15.155:0/829427662 wait complete. 2024-08-17T02:27:50.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:50.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 Processor -- start 2024-08-17T02:27:50.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 -- start start 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7268159ce0 0x7f726815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 0x7f7268153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f72680b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72681578c0 con 0x7f7268159ce0 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72681575c0 con 0x7f7268153430 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e86d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72680b16c0 con 0x7f72680b0960 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7268159ce0 0x7f726815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7268159ce0 0x7f726815a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52458/0 (socket says 172.21.15.155:52458) 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 -- 172.21.15.155:0/271554454 learned_addr learned my addr 172.21.15.155:0/271554454 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d06a700 1 --2- 172.21.15.155:0/271554454 >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 0x7f7268153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e06c700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f72680b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 -- 172.21.15.155:0/271554454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 msgr2=0x7f72680b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f72680b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 -- 172.21.15.155:0/271554454 >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 msgr2=0x7f7268153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 --2- 172.21.15.155:0/271554454 >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 0x7f7268153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 -- 172.21.15.155:0/271554454 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680b19a0 con 0x7f7268159ce0 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d06a700 1 --2- 172.21.15.155:0/271554454 >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 0x7f7268153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726e06c700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f72680b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726d86b700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726815a0b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f726806d550 tx=0x7f7264009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fc0a64022fe5d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.292+0000 7f726c869700 1 -- 172.21.15.155:0/271554454 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400e070 con 0x7f7268159ce0 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726c869700 1 -- 172.21.15.155:0/271554454 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400ba50 con 0x7f7268159ce0 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726c869700 1 -- 172.21.15.155:0/271554454 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640092e0 con 0x7f7268159ce0 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 -- 172.21.15.155:0/271554454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 msgr2=0x7f726815a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726815a0b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f726806d550 tx=0x7f7264009840 comp rx=0 tx=0).stop 2024-08-17T02:27:50.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 -- 172.21.15.155:0/271554454 shutdown_connections 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f72680b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 --2- 172.21.15.155:0/271554454 >> v2:172.21.15.189:3300/0 conn(0x7f7268153430 0x7f7268153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 --2- 172.21.15.155:0/271554454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726815a0b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 -- 172.21.15.155:0/271554454 >> 172.21.15.155:0/271554454 conn(0x7f72680c9840 msgr2=0x7f72680c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 -- 172.21.15.155:0/271554454 shutdown_connections 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.296+0000 7f726e86d700 1 -- 172.21.15.155:0/271554454 wait complete. 2024-08-17T02:27:50.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 Processor -- start 2024-08-17T02:27:50.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- start start 2024-08-17T02:27:50.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f726814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7268153430 0x7f726814b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726814b8c0 con 0x7f7268159ce0 2024-08-17T02:27:50.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680697a0 con 0x7f7268153430 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268069cd0 con 0x7f72680b0960 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52470/0 (socket says 172.21.15.155:52470) 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 -- 172.21.15.155:0/2425994722 learned_addr learned my addr 172.21.15.155:0/2425994722 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726d86b700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f726814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726d06a700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7268153430 0x7f726814b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 -- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 msgr2=0x7f726814aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f726814aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 -- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7268153430 msgr2=0x7f726814b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7268153430 0x7f726814b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 -- 172.21.15.155:0/2425994722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009ae0 con 0x7f7268159ce0 2024-08-17T02:27:50.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e06c700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f726000c880 tx=0x7f7260008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011660 con 0x7f7268159ce0 2024-08-17T02:27:50.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72600117c0 con 0x7f7268159ce0 2024-08-17T02:27:50.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726806b570 con 0x7f7268159ce0 2024-08-17T02:27:50.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011b80 con 0x7f7268159ce0 2024-08-17T02:27:50.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.300+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726806afb0 con 0x7f7268159ce0 2024-08-17T02:27:50.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726814a7c0 con 0x7f7268159ce0 2024-08-17T02:27:50.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7260021350 con 0x7f7268159ce0 2024-08-17T02:27:50.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f7259ffb700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 0x7f724c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f726007c9c0 con 0x7f7268159ce0 2024-08-17T02:27:50.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f726d86b700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 0x7f724c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.304+0000 7f726d86b700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 0x7f724c062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7264009880 tx=0x7f7264018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.312+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f726814a7c0 con 0x7f7268159ce0 2024-08-17T02:27:50.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.476+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726814a7c0 con 0x7f7268159ce0 2024-08-17T02:27:50.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f7259ffb700 1 -- 172.21.15.155:0/2425994722 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f726814a7c0 con 0x7f7268159ce0 2024-08-17T02:27:50.482 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:50.482 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 msgr2=0x7f724c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 0x7f724c062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7264009880 tx=0x7f7264018000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 msgr2=0x7f726814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f726000c880 tx=0x7f7260008040 comp rx=0 tx=0).stop 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 shutdown_connections 2024-08-17T02:27:50.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f724c060860 0x7f724c062d10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7268159ce0 0x7f726814d0b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7268153430 0x7f726814b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 --2- 172.21.15.155:0/2425994722 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72680b0960 0x7f726814aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 >> 172.21.15.155:0/2425994722 conn(0x7f72680c9840 msgr2=0x7f72680cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 shutdown_connections 2024-08-17T02:27:50.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.480+0000 7f726e86d700 1 -- 172.21.15.155:0/2425994722 wait complete. 2024-08-17T02:27:50.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:50.496 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:50.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.604+0000 7f1a4ebb5700 1 Processor -- start 2024-08-17T02:27:50.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.604+0000 7f1a4ebb5700 1 -- start start 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1a48067030 0x7f1a48067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 0x7f1a481590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480cf670 con 0x7f1a480cfb00 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480cea60 con 0x7f1a48067030 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480ced40 con 0x7f1a48158cc0 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4d3b2700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1a480cfb00 0x7f1a480cb080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48040/0 (socket says 172.21.15.155:48040) 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4d3b2700 1 -- 172.21.15.155:0/2881276878 learned_addr learned my addr 172.21.15.155:0/2881276878 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 --2- 172.21.15.155:0/2881276878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 0x7f1a481590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4dbb3700 1 --2- 172.21.15.155:0/2881276878 >> v2:172.21.15.189:3300/0 conn(0x7f1a48067030 0x7f1a48067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4cbb1700 1 -- 172.21.15.155:0/2881276878 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272277981 0 0) 0x7f1a480cf670 con 0x7f1a480cfb00 2024-08-17T02:27:50.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4cbb1700 1 -- 172.21.15.155:0/2881276878 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a34003570 con 0x7f1a480cfb00 2024-08-17T02:27:50.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 -- 172.21.15.155:0/2881276878 >> v2:172.21.15.189:3300/0 conn(0x7f1a48067030 msgr2=0x7f1a48067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 --2- 172.21.15.155:0/2881276878 >> v2:172.21.15.189:3300/0 conn(0x7f1a48067030 0x7f1a48067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 -- 172.21.15.155:0/2881276878 >> v1:172.21.15.155:6789/0 conn(0x7f1a480cfb00 legacy=0x7f1a480cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 -- 172.21.15.155:0/2881276878 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480cf020 con 0x7f1a48158cc0 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4e3b4700 1 --2- 172.21.15.155:0/2881276878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 0x7f1a481590d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009e60 tx=0x7f1a40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c685f67defe8d53 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4cbb1700 1 -- 172.21.15.155:0/2881276878 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000e070 con 0x7f1a48158cc0 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4cbb1700 1 -- 172.21.15.155:0/2881276878 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000bab0 con 0x7f1a48158cc0 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4cbb1700 1 -- 172.21.15.155:0/2881276878 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000be70 con 0x7f1a48158cc0 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/2881276878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 msgr2=0x7f1a481590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/2881276878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 0x7f1a481590d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009e60 tx=0x7f1a40009780 comp rx=0 tx=0).stop 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/2881276878 shutdown_connections 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/2881276878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a48158cc0 0x7f1a481590d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/2881276878 >> v2:172.21.15.189:3300/0 conn(0x7f1a48067030 0x7f1a48067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/2881276878 >> 172.21.15.155:0/2881276878 conn(0x7f1a480d0b50 msgr2=0x7f1a480ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/2881276878 shutdown_connections 2024-08-17T02:27:50.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.608+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/2881276878 wait complete. 2024-08-17T02:27:50.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.612+0000 7f1a4ebb5700 1 Processor -- start 2024-08-17T02:27:50.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.612+0000 7f1a4ebb5700 1 -- start start 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a480cfb00 0x7f1a48156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a48158cc0 0x7f1a48169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48159150 con 0x7f1a48067030 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4815a330 con 0x7f1a48158cc0 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4815a610 con 0x7f1a480cfb00 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52482/0 (socket says 172.21.15.155:52482) 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 -- 172.21.15.155:0/479058088 learned_addr learned my addr 172.21.15.155:0/479058088 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4d3b2700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a480cfb00 0x7f1a48156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4e3b4700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a48158cc0 0x7f1a48169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 -- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a480cfb00 msgr2=0x7f1a48156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a480cfb00 0x7f1a48156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 -- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a48158cc0 msgr2=0x7f1a48169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a48158cc0 0x7f1a48169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 -- 172.21.15.155:0/479058088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40009a20 con 0x7f1a48067030 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4dbb3700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ec80 tx=0x7f1a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00c850 con 0x7f1a48067030 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c00c9b0 con 0x7f1a48067030 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4815a8f0 con 0x7f1a48067030 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00cd50 con 0x7f1a48067030 2024-08-17T02:27:50.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a48151e50 con 0x7f1a48067030 2024-08-17T02:27:50.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.616+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a480638f0 con 0x7f1a48067030 2024-08-17T02:27:50.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.620+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a3c013680 con 0x7f1a48067030 2024-08-17T02:27:50.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.620+0000 7f1a39ffb700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 0x7f1a2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.620+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a3c07ce70 con 0x7f1a48067030 2024-08-17T02:27:50.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.620+0000 7f1a4d3b2700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 0x7f1a2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.620+0000 7f1a4d3b2700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 0x7f1a2c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a4815ce70 tx=0x7f1a44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.628+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a3c04d220 con 0x7f1a48067030 2024-08-17T02:27:50.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a48157160 con 0x7f1a48067030 2024-08-17T02:27:50.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a39ffb700 1 -- 172.21.15.155:0/479058088 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a3c050840 con 0x7f1a48067030 2024-08-17T02:27:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 msgr2=0x7f1a2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 0x7f1a2c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a4815ce70 tx=0x7f1a44009040 comp rx=0 tx=0).stop 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 msgr2=0x7f1a48151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ec80 tx=0x7f1a3c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 shutdown_connections 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a2c060860 0x7f1a2c062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a48158cc0 0x7f1a48169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1a480cfb00 0x7f1a48156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 --2- 172.21.15.155:0/479058088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a48067030 0x7f1a48151690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.792+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 >> 172.21.15.155:0/479058088 conn(0x7f1a480d0b50 msgr2=0x7f1a480cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.796+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 shutdown_connections 2024-08-17T02:27:50.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.796+0000 7f1a4ebb5700 1 -- 172.21.15.155:0/479058088 wait complete. 2024-08-17T02:27:50.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:50.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 Processor -- start 2024-08-17T02:27:50.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 -- start start 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142c40 0x7fa084067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa084067970 0x7fa08415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08415cde0 con 0x7fa084142870 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa084067d90 con 0x7fa084067970 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08c6d8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415d030 con 0x7fa084142c40 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa084067970 0x7fa08415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa084067970 0x7fa08415ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52496/0 (socket says 172.21.15.155:52496) 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08a474700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa084142870 0x7fa0840b05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48044/0 (socket says 172.21.15.155:48044) 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 -- 172.21.15.155:0/1153733999 learned_addr learned my addr 172.21.15.155:0/1153733999 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa089c73700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142c40 0x7fa084067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 -- 172.21.15.155:0/1153733999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142c40 msgr2=0x7fa084067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142c40 0x7fa084067430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 -- 172.21.15.155:0/1153733999 >> v1:172.21.15.155:6789/0 conn(0x7fa084142870 legacy=0x7fa0840b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 -- 172.21.15.155:0/1153733999 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08415d310 con 0x7fa084067970 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa089472700 1 -- 172.21.15.155:0/1153733999 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678868509 0 0) 0x7fa08415cde0 con 0x7fa084142870 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa08ac75700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa08415ab50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f69e91e86ea0ae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.916+0000 7fa089472700 1 -- 172.21.15.155:0/1153733999 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00b860 con 0x7fa084067970 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa089472700 1 -- 172.21.15.155:0/1153733999 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00b9c0 con 0x7fa084067970 2024-08-17T02:27:50.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa089472700 1 -- 172.21.15.155:0/1153733999 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00bd60 con 0x7fa084067970 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1153733999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 msgr2=0x7fa08415ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa08415ab50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0099b0 tx=0x7fa07c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1153733999 shutdown_connections 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa08415ab50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1153733999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142c40 0x7fa084067430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1153733999 >> 172.21.15.155:0/1153733999 conn(0x7fa0840687a0 msgr2=0x7fa08406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1153733999 shutdown_connections 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1153733999 wait complete. 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 Processor -- start 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.920+0000 7fa08c6d8700 1 -- start start 2024-08-17T02:27:50.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142870 0x7fa0840cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa084142c40 0x7fa08416c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840af670 con 0x7fa084067970 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840af1e0 con 0x7fa084142c40 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840ada80 con 0x7fa084142870 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52506/0 (socket says 172.21.15.155:52506) 2024-08-17T02:27:50.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 -- 172.21.15.155:0/1091194889 learned_addr learned my addr 172.21.15.155:0/1091194889 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08ac75700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa084142c40 0x7fa08416c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa089c73700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142870 0x7fa0840cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 -- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142870 msgr2=0x7fa0840cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142870 0x7fa0840cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 -- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa084142c40 msgr2=0x7fa08416c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa084142c40 0x7fa08416c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 -- 172.21.15.155:0/1091194889 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0094f0 con 0x7fa084067970 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08a474700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa07400ce00 tx=0x7fa074001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074005df0 con 0x7fa084067970 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400a9f0 con 0x7fa084067970 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0840ae5d0 con 0x7fa084067970 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400adb0 con 0x7fa084067970 2024-08-17T02:27:50.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840aeb90 con 0x7fa084067970 2024-08-17T02:27:50.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.924+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0840645c0 con 0x7fa084067970 2024-08-17T02:27:50.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.928+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa074007300 con 0x7fa084067970 2024-08-17T02:27:50.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.928+0000 7fa0827fc700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 0x7fa064062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.928+0000 7fa089c73700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 0x7fa064062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.928+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa07407cdf0 con 0x7fa084067970 2024-08-17T02:27:50.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.928+0000 7fa089c73700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 0x7fa064062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa08406ac00 tx=0x7fa06c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:50.932+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa07404d2c0 con 0x7fa084067970 2024-08-17T02:27:51.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.096+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0840681b0 con 0x7fa084067970 2024-08-17T02:27:51.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa0827fc700 1 -- 172.21.15.155:0/1091194889 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0740508e0 con 0x7fa084067970 2024-08-17T02:27:51.102 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:51.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 msgr2=0x7fa064062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 0x7fa064062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa08406ac00 tx=0x7fa06c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 msgr2=0x7fa0840ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa07400ce00 tx=0x7fa074001bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 shutdown_connections 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa064060860 0x7fa064062d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa084142c40 0x7fa08416c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa084142870 0x7fa0840cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 --2- 172.21.15.155:0/1091194889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa084067970 0x7fa0840ad540 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 >> 172.21.15.155:0/1091194889 conn(0x7fa0840687a0 msgr2=0x7fa0841415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 shutdown_connections 2024-08-17T02:27:51.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.100+0000 7fa08c6d8700 1 -- 172.21.15.155:0/1091194889 wait complete. 2024-08-17T02:27:51.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 Processor -- start 2024-08-17T02:27:51.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 -- start start 2024-08-17T02:27:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4b80af190 0x7fa4b80b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8140f70 con 0x7fa4b806e470 2024-08-17T02:27:51.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8141250 con 0x7fa4b806e840 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8141530 con 0x7fa4b80af190 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4b80af190 0x7fa4b80b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4b80af190 0x7fa4b80b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52514/0 (socket says 172.21.15.155:52514) 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 -- 172.21.15.155:0/477483272 learned_addr learned my addr 172.21.15.155:0/477483272 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b6ffd700 1 --1- 172.21.15.155:0/477483272 >> v1:172.21.15.155:6789/0 conn(0x7fa4b806e470 0x7fa4b80aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48058/0 (socket says 172.21.15.155:48058) 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 -- 172.21.15.155:0/477483272 >> v1:172.21.15.189:6789/0 conn(0x7fa4b806e840 legacy=0x7fa4b80b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 -- 172.21.15.155:0/477483272 >> v1:172.21.15.155:6789/0 conn(0x7fa4b806e470 legacy=0x7fa4b80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 -- 172.21.15.155:0/477483272 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8141810 con 0x7fa4b80af190 2024-08-17T02:27:51.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b67fc700 1 --2- 172.21.15.155:0/477483272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b80af190 0x7fa4b80b0ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00099b0 tx=0x7fa4a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdf41d19538f60e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b5ffb700 1 -- 172.21.15.155:0/477483272 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000b860 con 0x7fa4b80af190 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b5ffb700 1 -- 172.21.15.155:0/477483272 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000b9c0 con 0x7fa4b80af190 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.224+0000 7fa4b5ffb700 1 -- 172.21.15.155:0/477483272 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000bd60 con 0x7fa4b80af190 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- 172.21.15.155:0/477483272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b80af190 msgr2=0x7fa4b80b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/477483272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b80af190 0x7fa4b80b0ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00099b0 tx=0x7fa4a0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- 172.21.15.155:0/477483272 shutdown_connections 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/477483272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b80af190 0x7fa4b80b0ef0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- 172.21.15.155:0/477483272 >> 172.21.15.155:0/477483272 conn(0x7fa4b80678a0 msgr2=0x7fa4b8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- 172.21.15.155:0/477483272 shutdown_connections 2024-08-17T02:27:51.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- 172.21.15.155:0/477483272 wait complete. 2024-08-17T02:27:51.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 Processor -- start 2024-08-17T02:27:51.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- start start 2024-08-17T02:27:51.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 0x7fa4b80c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4b80af190 0x7fa4b806d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c70b0 con 0x7fa4b806e470 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c6c20 con 0x7fa4b80af190 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.228+0000 7fa4b7fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c6010 con 0x7fa4b806e840 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52530/0 (socket says 172.21.15.155:52530) 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 -- 172.21.15.155:0/2300144067 learned_addr learned my addr 172.21.15.155:0/2300144067 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b77fe700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4b80af190 0x7fa4b806d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b67fc700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 0x7fa4b80c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 -- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 msgr2=0x7fa4b80c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 0x7fa4b80c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 -- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4b80af190 msgr2=0x7fa4b806d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4b80af190 0x7fa4b806d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 -- 172.21.15.155:0/2300144067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00094f0 con 0x7fa4b806e470 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b67fc700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 0x7fa4b80c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b6ffd700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c560 tx=0x7fa4a8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8005a70 con 0x7fa4b806e470 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005bd0 con 0x7fa4b806e470 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c62f0 con 0x7fa4b806e470 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80070d0 con 0x7fa4b806e470 2024-08-17T02:27:51.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c68b0 con 0x7fa4b806e470 2024-08-17T02:27:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8064330 con 0x7fa4b806e470 2024-08-17T02:27:51.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa4a8007480 con 0x7fa4b806e470 2024-08-17T02:27:51.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 0x7fa498062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4a807c180 con 0x7fa4b806e470 2024-08-17T02:27:51.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.232+0000 7fa4b67fc700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 0x7fa498062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.236+0000 7fa4b67fc700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 0x7fa498062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00099b0 tx=0x7fa4a0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.240+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa4a804c530 con 0x7fa4b806e470 2024-08-17T02:27:51.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.404+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4b806ed70 con 0x7fa4b806e470 2024-08-17T02:27:51.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.404+0000 7fa4aeffd700 1 -- 172.21.15.155:0/2300144067 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4a804fb50 con 0x7fa4b806e470 2024-08-17T02:27:51.408 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 msgr2=0x7fa498062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 0x7fa498062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00099b0 tx=0x7fa4a0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 msgr2=0x7fa4b815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c560 tx=0x7fa4a8007f70 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 shutdown_connections 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa498060860 0x7fa498062d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4b80af190 0x7fa4b806d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa4b806e840 0x7fa4b80c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 --2- 172.21.15.155:0/2300144067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b806e470 0x7fa4b815a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 >> 172.21.15.155:0/2300144067 conn(0x7fa4b80678a0 msgr2=0x7fa4b815d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 shutdown_connections 2024-08-17T02:27:51.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.408+0000 7fa4b7fff700 1 -- 172.21.15.155:0/2300144067 wait complete. 2024-08-17T02:27:51.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:51.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 Processor -- start 2024-08-17T02:27:51.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 -- start start 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5abc06f040 0x7f5abc0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc0adf50 con 0x7f5abc0ace80 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc0ae920 con 0x7f5abc06f040 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac2333700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0ad340 con 0x7f5abc156f80 2024-08-17T02:27:51.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5abc06f040 0x7f5abc0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5abc06f040 0x7f5abc0aab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52542/0 (socket says 172.21.15.155:52542) 2024-08-17T02:27:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 -- 172.21.15.155:0/347616015 learned_addr learned my addr 172.21.15.155:0/347616015 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:51.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5abbfff700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 -- 172.21.15.155:0/347616015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 msgr2=0x7f5abc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc0ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 -- 172.21.15.155:0/347616015 >> v1:172.21.15.189:6789/0 conn(0x7f5abc0ace80 legacy=0x7f5abc157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 -- 172.21.15.155:0/347616015 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0ad620 con 0x7f5abc06f040 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5abbfff700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5ac08d0700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc06f040 0x7f5abc0aab70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009f20 tx=0x7f5ab4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb94894f3b3ea38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5abaffd700 1 -- 172.21.15.155:0/347616015 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400e070 con 0x7f5abc06f040 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5abaffd700 1 -- 172.21.15.155:0/347616015 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab400ba80 con 0x7f5abc06f040 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.528+0000 7f5abaffd700 1 -- 172.21.15.155:0/347616015 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40092e0 con 0x7f5abc06f040 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- 172.21.15.155:0/347616015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc06f040 msgr2=0x7f5abc0aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc06f040 0x7f5abc0aab70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009f20 tx=0x7f5ab4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- 172.21.15.155:0/347616015 shutdown_connections 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc06f040 0x7f5abc0aab70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 --2- 172.21.15.155:0/347616015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- 172.21.15.155:0/347616015 >> 172.21.15.155:0/347616015 conn(0x7f5abc066e00 msgr2=0x7f5abc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- 172.21.15.155:0/347616015 shutdown_connections 2024-08-17T02:27:51.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- 172.21.15.155:0/347616015 wait complete. 2024-08-17T02:27:51.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 Processor -- start 2024-08-17T02:27:51.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.532+0000 7f5ac2333700 1 -- start start 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 0x7f5abc15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc13f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc15b7d0 con 0x7f5abc0ace80 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc15bab0 con 0x7f5abc06f040 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc15bd90 con 0x7f5abc156f80 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 0x7f5abc15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac08d0700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc13f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:52086/0 (socket says 172.21.15.155:52086) 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 -- 172.21.15.155:0/985716344 learned_addr learned my addr 172.21.15.155:0/985716344 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 -- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 msgr2=0x7f5abc13f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc13f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 -- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 msgr2=0x7f5abc15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 0x7f5abc15aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 -- 172.21.15.155:0/985716344 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4009ae0 con 0x7f5abc06f040 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abb7fe700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 0x7f5abc15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:51.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5abbfff700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00d860 tx=0x7f5aac008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0125f0 con 0x7f5abc06f040 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac012750 con 0x7f5abc06f040 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc15c070 con 0x7f5abc06f040 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac012af0 con 0x7f5abc06f040 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc15b410 con 0x7f5abc06f040 2024-08-17T02:27:51.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.536+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc15c570 con 0x7f5abc06f040 2024-08-17T02:27:51.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.540+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5aac013480 con 0x7f5abc06f040 2024-08-17T02:27:51.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.540+0000 7f5ab3fff700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 0x7f5aa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.540+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aac07d850 con 0x7f5abc06f040 2024-08-17T02:27:51.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.540+0000 7f5abb7fe700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 0x7f5aa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.540+0000 7f5abb7fe700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 0x7f5aa0062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0996c0 tx=0x7f5aa4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.548+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5aac04dc80 con 0x7f5abc06f040 2024-08-17T02:27:51.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.712+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5abc0645c0 con 0x7f5abc06f040 2024-08-17T02:27:51.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.712+0000 7f5ab3fff700 1 -- 172.21.15.155:0/985716344 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5aac0512a0 con 0x7f5abc06f040 2024-08-17T02:27:51.718 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:51.718 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:51.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 msgr2=0x7f5aa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 0x7f5aa0062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0996c0 tx=0x7f5aa4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 msgr2=0x7f5abc15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00d860 tx=0x7f5aac008040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 shutdown_connections 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5aa0060860 0x7f5aa0062d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5abc156f80 0x7f5abc13f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5abc0ace80 0x7f5abc15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 --2- 172.21.15.155:0/985716344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5abc06f040 0x7f5abc15d670 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 >> 172.21.15.155:0/985716344 conn(0x7f5abc066e00 msgr2=0x7f5abc0a9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 shutdown_connections 2024-08-17T02:27:51.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.716+0000 7f5ac2333700 1 -- 172.21.15.155:0/985716344 wait complete. 2024-08-17T02:27:51.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:51.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.840+0000 7f1425f4d700 1 Processor -- start 2024-08-17T02:27:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.840+0000 7f1425f4d700 1 -- start start 2024-08-17T02:27:51.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f14201514d0 0x7f142006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1420157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142006e010 con 0x7f14200b0d90 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142006efa0 con 0x7f14201514d0 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420157fb0 con 0x7f14201574f0 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f142574c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f14200b0d90 0x7f14200c96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48068/0 (socket says 172.21.15.155:48068) 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f142574c700 1 -- 172.21.15.155:0/1703815710 learned_addr learned my addr 172.21.15.155:0/1703815710 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1424f4b700 1 --2- 172.21.15.155:0/1703815710 >> v2:172.21.15.189:3300/0 conn(0x7f14201514d0 0x7f142006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928121114 0 0) 0x7f142006e010 con 0x7f14200b0d90 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1400003570 con 0x7f14200b0d90 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1420157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653341942 0 0) 0x7f1400003570 con 0x7f14200b0d90 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 msgr2=0x7f1420157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1420157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 >> v2:172.21.15.189:3300/0 conn(0x7f14201514d0 msgr2=0x7f142006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 --2- 172.21.15.155:0/1703815710 >> v2:172.21.15.189:3300/0 conn(0x7f14201514d0 0x7f142006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420158290 con 0x7f14200b0d90 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f1418001470 con 0x7f14200b0d90 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 >> v1:172.21.15.155:6789/0 conn(0x7f14200b0d90 legacy=0x7f14200c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1400003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f1400004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1400004d50 0x7f14000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142006efa0 con 0x7f1400004090 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420157fb0 con 0x7f1400004d50 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1400010000 con 0x7f14201574f0 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f1400004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f142574c700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1400004d50 0x7f14000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1424f4b700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1400003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 -- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 msgr2=0x7f1400003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14201574f0 0x7f1400003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 -- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1400004d50 msgr2=0x7f14000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1400004d50 0x7f14000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 -- 172.21.15.155:0/1703815710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400003570 con 0x7f1400004090 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141ffff700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f1400004810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1408007440 tx=0x7f1408009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23119f5627a1b821 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408009a40 con 0x7f1400004090 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408007cf0 con 0x7f1400004090 2024-08-17T02:27:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f141f7fe700 1 -- 172.21.15.155:0/1703815710 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408014630 con 0x7f1400004090 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- 172.21.15.155:0/1703815710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 msgr2=0x7f1400004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 --2- 172.21.15.155:0/1703815710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f1400004810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1408007440 tx=0x7f1408009710 comp rx=0 tx=0).stop 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f142574c700 1 -- 172.21.15.155:0/1703815710 reap_dead start 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- 172.21.15.155:0/1703815710 shutdown_connections 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- 172.21.15.155:0/1703815710 >> 172.21.15.155:0/1703815710 conn(0x7f14200678a0 msgr2=0x7f1420067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- 172.21.15.155:0/1703815710 shutdown_connections 2024-08-17T02:27:51.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.844+0000 7f1425f4d700 1 -- 172.21.15.155:0/1703815710 wait complete. 2024-08-17T02:27:51.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.848+0000 7f1425f4d700 1 Processor -- start 2024-08-17T02:27:51.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.848+0000 7f1425f4d700 1 -- start start 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 0x7f14200ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14200ace60 0x7f142014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200b0430 con 0x7f1400004090 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200af9a0 con 0x7f142006ad10 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420164b20 con 0x7f14200ace60 2024-08-17T02:27:51.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52558/0 (socket says 172.21.15.155:52558) 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 -- 172.21.15.155:0/2108565591 learned_addr learned my addr 172.21.15.155:0/2108565591 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f141ffff700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 0x7f14200ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f142574c700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14200ace60 0x7f142014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 -- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14200ace60 msgr2=0x7f142014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14200ace60 0x7f142014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 -- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 msgr2=0x7f14200ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 0x7f14200ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 -- 172.21.15.155:0/2108565591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200afb90 con 0x7f1400004090 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f141ffff700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 0x7f14200ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1424f4b700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f141000f910 tx=0x7f1410008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000d650 con 0x7f1400004090 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000d7b0 con 0x7f1400004090 2024-08-17T02:27:51.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000db70 con 0x7f1400004090 2024-08-17T02:27:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200afe70 con 0x7f1400004090 2024-08-17T02:27:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142006b180 con 0x7f1400004090 2024-08-17T02:27:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.852+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14200b0060 con 0x7f1400004090 2024-08-17T02:27:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.856+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1410014460 con 0x7f1400004090 2024-08-17T02:27:51.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.856+0000 7f141cff9700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 0x7f1404062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.856+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f141007d5c0 con 0x7f1400004090 2024-08-17T02:27:51.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.856+0000 7f141ffff700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 0x7f1404062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.856+0000 7f141ffff700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 0x7f1404062d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1408007440 tx=0x7f1408018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:51.864+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f141004da10 con 0x7f1400004090 2024-08-17T02:27:52.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.020+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14200b0270 con 0x7f1400004090 2024-08-17T02:27:52.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.020+0000 7f141cff9700 1 -- 172.21.15.155:0/2108565591 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1410051030 con 0x7f1400004090 2024-08-17T02:27:52.024 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 msgr2=0x7f1404062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 0x7f1404062d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1408007440 tx=0x7f1408018000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 msgr2=0x7f14200af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f141000f910 tx=0x7f1410008040 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 shutdown_connections 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1404060890 0x7f1404062d40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f14200ace60 0x7f142014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f142006ad10 0x7f14200ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 --2- 172.21.15.155:0/2108565591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1400004090 0x7f14200af460 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 >> 172.21.15.155:0/2108565591 conn(0x7f14200678a0 msgr2=0x7f1420159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 shutdown_connections 2024-08-17T02:27:52.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.024+0000 7f1425f4d700 1 -- 172.21.15.155:0/2108565591 wait complete. 2024-08-17T02:27:52.038 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:52.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.144+0000 7f75c6919700 1 Processor -- start 2024-08-17T02:27:52.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.144+0000 7f75c6919700 1 -- start start 2024-08-17T02:27:52.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75c0159300 0x7f75c00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c00cba90 con 0x7f75c01596d0 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c00cb160 con 0x7f75c0067510 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c00b2b60 con 0x7f75c0159300 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75c0159300 0x7f75c00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bf7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f75c01596d0 0x7f75c0066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48082/0 (socket says 172.21.15.155:48082) 2024-08-17T02:27:52.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bf7fe700 1 -- 172.21.15.155:0/2230613620 learned_addr learned my addr 172.21.15.155:0/2230613620 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bffff700 1 -- 172.21.15.155:0/2230613620 >> v1:172.21.15.189:6789/0 conn(0x7f75c0067510 legacy=0x7f75c00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75beffd700 1 -- 172.21.15.155:0/2230613620 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448877016 0 0) 0x7f75c00cba90 con 0x7f75c01596d0 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bffff700 1 -- 172.21.15.155:0/2230613620 >> v1:172.21.15.155:6789/0 conn(0x7f75c01596d0 legacy=0x7f75c0066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bffff700 1 -- 172.21.15.155:0/2230613620 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00cb440 con 0x7f75c0159300 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75bffff700 1 --2- 172.21.15.155:0/2230613620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0159300 0x7f75c00b2230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75b00098e0 tx=0x7f75b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484b981e14b2a36d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75beffd700 1 -- 172.21.15.155:0/2230613620 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0009e80 con 0x7f75c0159300 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75beffd700 1 -- 172.21.15.155:0/2230613620 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000b860 con 0x7f75c0159300 2024-08-17T02:27:52.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75beffd700 1 -- 172.21.15.155:0/2230613620 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b000bbe0 con 0x7f75c0159300 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- 172.21.15.155:0/2230613620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0159300 msgr2=0x7f75c00b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 --2- 172.21.15.155:0/2230613620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0159300 0x7f75c00b2230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75b00098e0 tx=0x7f75b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- 172.21.15.155:0/2230613620 shutdown_connections 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 --2- 172.21.15.155:0/2230613620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0159300 0x7f75c00b2230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- 172.21.15.155:0/2230613620 >> 172.21.15.155:0/2230613620 conn(0x7f75c00682c0 msgr2=0x7f75c00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- 172.21.15.155:0/2230613620 shutdown_connections 2024-08-17T02:27:52.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.148+0000 7f75c6919700 1 -- 172.21.15.155:0/2230613620 wait complete. 2024-08-17T02:27:52.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 Processor -- start 2024-08-17T02:27:52.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 -- start start 2024-08-17T02:27:52.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75c0159300 0x7f75c015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 0x7f75c00d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c6c30 con 0x7f75c0067510 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c5b90 con 0x7f75c0159300 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c6919700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c5e70 con 0x7f75c01596d0 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52568/0 (socket says 172.21.15.155:52568) 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 -- 172.21.15.155:0/975504983 learned_addr learned my addr 172.21.15.155:0/975504983 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bf7fe700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75c0159300 0x7f75c015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c4eb6700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 0x7f75c00d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 -- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 msgr2=0x7f75c00d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 0x7f75c00d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 -- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75c0159300 msgr2=0x7f75c015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75c0159300 0x7f75c015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 -- 172.21.15.155:0/975504983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0009420 con 0x7f75c0067510 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75c4eb6700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 0x7f75c00d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:52.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75bffff700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75c00cde20 tx=0x7f75b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.152+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b001f070 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0000c90 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c00c6150 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0025420 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c00c6710 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f75b0023070 con 0x7f75c0067510 2024-08-17T02:27:52.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c00645c0 con 0x7f75c0067510 2024-08-17T02:27:52.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75a7fff700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 0x7f75ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75b007e0a0 con 0x7f75c0067510 2024-08-17T02:27:52.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75bf7fe700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 0x7f75ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.156+0000 7f75bf7fe700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 0x7f75ac062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ce220 tx=0x7f75b4007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.164+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f75b004e4f0 con 0x7f75c0067510 2024-08-17T02:27:52.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75c00caac0 con 0x7f75c0067510 2024-08-17T02:27:52.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75a7fff700 1 -- 172.21.15.155:0/975504983 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75b0051b10 con 0x7f75c0067510 2024-08-17T02:27:52.331 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 msgr2=0x7f75ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 0x7f75ac062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ce220 tx=0x7f75b4007f30 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 msgr2=0x7f75c00c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.328+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75c00cde20 tx=0x7f75b0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 shutdown_connections 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f75ac060860 0x7f75ac062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75c01596d0 0x7f75c00d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75c0159300 0x7f75c015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 --2- 172.21.15.155:0/975504983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75c0067510 0x7f75c00c2e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 >> 172.21.15.155:0/975504983 conn(0x7f75c00682c0 msgr2=0x7f75c00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 shutdown_connections 2024-08-17T02:27:52.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.332+0000 7f75c6919700 1 -- 172.21.15.155:0/975504983 wait complete. 2024-08-17T02:27:52.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:52.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.456+0000 7f26d1328700 1 Processor -- start 2024-08-17T02:27:52.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.456+0000 7f26d1328700 1 -- start start 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.456+0000 7f26d1328700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc13f680 0x7f26cc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f26cc13fa50 0x7f26cc0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0afc70 con 0x7f26cc0b0100 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0adc00 con 0x7f26cc13fa50 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0af060 con 0x7f26cc13f680 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f26cc13fa50 0x7f26cc0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d0b27700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f26cc0b0100 0x7f26cc06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:40860/0 (socket says 172.21.15.155:40860) 2024-08-17T02:27:52.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d0b27700 1 -- 172.21.15.155:0/887389963 learned_addr learned my addr 172.21.15.155:0/887389963 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:52.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cbfff700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc13f680 0x7f26cc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 -- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc13f680 msgr2=0x7f26cc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc13f680 0x7f26cc0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 -- 172.21.15.155:0/887389963 >> v1:172.21.15.189:6789/0 conn(0x7f26cc0b0100 legacy=0x7f26cc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 -- 172.21.15.155:0/887389963 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0af340 con 0x7f26cc13fa50 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26cb7fe700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc0ad6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26c00098e0 tx=0x7f26c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776b4024e6d53c6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26caffd700 1 -- 172.21.15.155:0/887389963 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000b640 con 0x7f26cc13fa50 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26caffd700 1 -- 172.21.15.155:0/887389963 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c000b7a0 con 0x7f26cc13fa50 2024-08-17T02:27:52.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26caffd700 1 -- 172.21.15.155:0/887389963 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000bb40 con 0x7f26cc13fa50 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 msgr2=0x7f26cc0ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc0ad6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26c00098e0 tx=0x7f26c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- 172.21.15.155:0/887389963 shutdown_connections 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc0ad6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 --2- 172.21.15.155:0/887389963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc13f680 0x7f26cc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- 172.21.15.155:0/887389963 >> 172.21.15.155:0/887389963 conn(0x7f26cc0678a0 msgr2=0x7f26cc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- 172.21.15.155:0/887389963 shutdown_connections 2024-08-17T02:27:52.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.460+0000 7f26d1328700 1 -- 172.21.15.155:0/887389963 wait complete. 2024-08-17T02:27:52.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 Processor -- start 2024-08-17T02:27:52.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- start start 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc0b0100 0x7f26cc1315a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc1309b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc131220 con 0x7f26cc13f680 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc14e0f0 con 0x7f26cc13fa50 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0cba00 con 0x7f26cc0b0100 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52580/0 (socket says 172.21.15.155:52580) 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 -- 172.21.15.155:0/1928856159 learned_addr learned my addr 172.21.15.155:0/1928856159 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d0b27700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc1309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cbfff700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc0b0100 0x7f26cc1315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 -- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc0b0100 msgr2=0x7f26cc1315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc0b0100 0x7f26cc1315a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 -- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 msgr2=0x7f26cc1309b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc1309b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 -- 172.21.15.155:0/1928856159 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009420 con 0x7f26cc13f680 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26cb7fe700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06fbb0 tx=0x7f26c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c001bd60 con 0x7f26cc13f680 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0011420 con 0x7f26cc13f680 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc14e580 con 0x7f26cc13f680 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00117e0 con 0x7f26cc13f680 2024-08-17T02:27:52.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.464+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc14daa0 con 0x7f26cc13f680 2024-08-17T02:27:52.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc14e280 con 0x7f26cc13f680 2024-08-17T02:27:52.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26c0011b50 con 0x7f26cc13f680 2024-08-17T02:27:52.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26b3fff700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 0x7f26b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26c007e250 con 0x7f26cc13f680 2024-08-17T02:27:52.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26cbfff700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 0x7f26b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.468+0000 7f26cbfff700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 0x7f26b8062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009d40 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.472+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26c004e6a0 con 0x7f26cc13f680 2024-08-17T02:27:52.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.632+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26cc064330 con 0x7f26cc13f680 2024-08-17T02:27:52.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26b3fff700 1 -- 172.21.15.155:0/1928856159 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26c0051cc0 con 0x7f26cc13f680 2024-08-17T02:27:52.638 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 msgr2=0x7f26b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 0x7f26b8062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009d40 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 msgr2=0x7f26cc0cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06fbb0 tx=0x7f26c0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 shutdown_connections 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f26b8060860 0x7f26b8062d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26cc13fa50 0x7f26cc1309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc13f680 0x7f26cc0cb4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 --2- 172.21.15.155:0/1928856159 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26cc0b0100 0x7f26cc1315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 >> 172.21.15.155:0/1928856159 conn(0x7f26cc0678a0 msgr2=0x7f26cc13e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 shutdown_connections 2024-08-17T02:27:52.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.636+0000 7f26d1328700 1 -- 172.21.15.155:0/1928856159 wait complete. 2024-08-17T02:27:52.711 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:27:52.711 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:52.712 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:52.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 Processor -- start 2024-08-17T02:27:52.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 -- start start 2024-08-17T02:27:52.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6de4153a50 0x7f6de40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6de40ae000 0x7f6de406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de415ce60 con 0x7f6de40ae430 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de415d0b0 con 0x7f6de4153a50 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6deb6c7700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de415d390 con 0x7f6de40ae000 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.820+0000 7f6de9463700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6de4153a50 0x7f6de40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6de4153a50 0x7f6de40687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52594/0 (socket says 172.21.15.155:52594) 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 -- 172.21.15.155:0/4259648795 learned_addr learned my addr 172.21.15.155:0/4259648795 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:52.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de8c62700 1 --2- 172.21.15.155:0/4259648795 >> v2:172.21.15.189:3300/0 conn(0x7f6de40ae000 0x7f6de406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 -- 172.21.15.155:0/4259648795 >> v2:172.21.15.189:3300/0 conn(0x7f6de40ae000 msgr2=0x7f6de406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 --2- 172.21.15.155:0/4259648795 >> v2:172.21.15.189:3300/0 conn(0x7f6de40ae000 0x7f6de406d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 -- 172.21.15.155:0/4259648795 >> v1:172.21.15.189:6789/0 conn(0x7f6de40ae430 legacy=0x7f6de40afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 -- 172.21.15.155:0/4259648795 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de415d670 con 0x7f6de4153a50 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6de9463700 1 --2- 172.21.15.155:0/4259648795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4153a50 0x7f6de40687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6de406e880 tx=0x7f6de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be31b85d6bb9f3cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6ddbfff700 1 -- 172.21.15.155:0/4259648795 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0009e70 con 0x7f6de4153a50 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6ddbfff700 1 -- 172.21.15.155:0/4259648795 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000b860 con 0x7f6de4153a50 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6ddbfff700 1 -- 172.21.15.155:0/4259648795 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000bc00 con 0x7f6de4153a50 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 -- 172.21.15.155:0/4259648795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4153a50 msgr2=0x7f6de40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/4259648795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4153a50 0x7f6de40687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6de406e880 tx=0x7f6de0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:52.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 -- 172.21.15.155:0/4259648795 shutdown_connections 2024-08-17T02:27:52.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/4259648795 >> v2:172.21.15.189:3300/0 conn(0x7f6de40ae000 0x7f6de406d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/4259648795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4153a50 0x7f6de40687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 -- 172.21.15.155:0/4259648795 >> 172.21.15.155:0/4259648795 conn(0x7f6de40ceb30 msgr2=0x7f6de406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 -- 172.21.15.155:0/4259648795 shutdown_connections 2024-08-17T02:27:52.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.824+0000 7f6deb6c7700 1 -- 172.21.15.155:0/4259648795 wait complete. 2024-08-17T02:27:52.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 Processor -- start 2024-08-17T02:27:52.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- start start 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6de40ae430 0x7f6de414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 0x7f6de414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de416d330 con 0x7f6de40ae000 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de414b110 con 0x7f6de40ae430 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de414b3f0 con 0x7f6de4153a50 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52602/0 (socket says 172.21.15.155:52602) 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 -- 172.21.15.155:0/3971943254 learned_addr learned my addr 172.21.15.155:0/3971943254 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de8c62700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6de40ae430 0x7f6de414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9c64700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 0x7f6de414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 -- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 msgr2=0x7f6de414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 0x7f6de414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 -- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6de40ae430 msgr2=0x7f6de414a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6de40ae430 0x7f6de414a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 -- 172.21.15.155:0/3971943254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00094f0 con 0x7f6de40ae000 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9c64700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 0x7f6de414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6de9463700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af660 tx=0x7f6de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0011420 con 0x7f6de40ae000 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00115a0 con 0x7f6de40ae000 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de416abb0 con 0x7f6de40ae000 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0011960 con 0x7f6de40ae000 2024-08-17T02:27:52.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.828+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de416b170 con 0x7f6de40ae000 2024-08-17T02:27:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de40645c0 con 0x7f6de40ae000 2024-08-17T02:27:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6de0011d50 con 0x7f6de40ae000 2024-08-17T02:27:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6dd97fa700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 0x7f6dc8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6de8c62700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 0x7f6dc8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6de007e1d0 con 0x7f6de40ae000 2024-08-17T02:27:52.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.832+0000 7f6de8c62700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 0x7f6dc8062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6de40adef0 tx=0x7f6dd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:52.840+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6de004e5c0 con 0x7f6de40ae000 2024-08-17T02:27:53.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.004+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6de40b3060 con 0x7f6de40ae000 2024-08-17T02:27:53.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.004+0000 7f6dd97fa700 1 -- 172.21.15.155:0/3971943254 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6de0051ba0 con 0x7f6de40ae000 2024-08-17T02:27:53.009 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:53.009 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 msgr2=0x7f6dc8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 0x7f6dc8062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6de40adef0 tx=0x7f6dd4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 msgr2=0x7f6de4152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af660 tx=0x7f6de0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 shutdown_connections 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6dc8060860 0x7f6dc8062d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6de4153a50 0x7f6de414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6de40ae430 0x7f6de414a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 --2- 172.21.15.155:0/3971943254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de40ae000 0x7f6de4152040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 >> 172.21.15.155:0/3971943254 conn(0x7f6de40ceb30 msgr2=0x7f6de40b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 shutdown_connections 2024-08-17T02:27:53.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.008+0000 7f6deb6c7700 1 -- 172.21.15.155:0/3971943254 wait complete. 2024-08-17T02:27:53.024 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:53.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:53.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 Processor -- start 2024-08-17T02:27:53.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 -- start start 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a500 0x7fa45c0ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa45c15a8d0 0x7fa45c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0b1540 con 0x7fa45c0b2250 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c06ed10 con 0x7fa45c15a8d0 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa461b57700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0b1dc0 con 0x7fa45c15a500 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa45c15a8d0 0x7fa45c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa45c15a8d0 0x7fa45c0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52610/0 (socket says 172.21.15.155:52610) 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 -- 172.21.15.155:0/477606697 learned_addr learned my addr 172.21.15.155:0/477606697 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45b7fe700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a500 0x7fa45c0ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 -- 172.21.15.155:0/477606697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a500 msgr2=0x7fa45c0ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a500 0x7fa45c0ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 -- 172.21.15.155:0/477606697 >> v1:172.21.15.189:6789/0 conn(0x7fa45c0b2250 legacy=0x7fa45c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.136+0000 7fa45affd700 1 -- 172.21.15.155:0/477606697 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c06ea30 con 0x7fa45c15a8d0 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa45affd700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a8d0 0x7fa45c0686a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4500099b0 tx=0x7fa450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1580a5ff0e7d38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa45a7fc700 1 -- 172.21.15.155:0/477606697 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450009ea0 con 0x7fa45c15a8d0 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa45a7fc700 1 -- 172.21.15.155:0/477606697 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000b860 con 0x7fa45c15a8d0 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa45a7fc700 1 -- 172.21.15.155:0/477606697 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000bc00 con 0x7fa45c15a8d0 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 -- 172.21.15.155:0/477606697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a8d0 msgr2=0x7fa45c0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a8d0 0x7fa45c0686a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4500099b0 tx=0x7fa450009250 comp rx=0 tx=0).stop 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 -- 172.21.15.155:0/477606697 shutdown_connections 2024-08-17T02:27:53.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a8d0 0x7fa45c0686a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 --2- 172.21.15.155:0/477606697 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a500 0x7fa45c0ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 -- 172.21.15.155:0/477606697 >> 172.21.15.155:0/477606697 conn(0x7fa45c0c9bf0 msgr2=0x7fa45c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 -- 172.21.15.155:0/477606697 shutdown_connections 2024-08-17T02:27:53.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.140+0000 7fa461b57700 1 -- 172.21.15.155:0/477606697 wait complete. 2024-08-17T02:27:53.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 Processor -- start 2024-08-17T02:27:53.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 -- start start 2024-08-17T02:27:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa45c0b2250 0x7fa45c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a8d0 0x7fa45c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c152bb0 con 0x7fa45c15a500 2024-08-17T02:27:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c152860 con 0x7fa45c0b2250 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa461b57700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c16a880 con 0x7fa45c15a8d0 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52620/0 (socket says 172.21.15.155:52620) 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 -- 172.21.15.155:0/1268553168 learned_addr learned my addr 172.21.15.155:0/1268553168 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45b7fe700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa45c0b2250 0x7fa45c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45bfff700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a8d0 0x7fa45c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 -- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a8d0 msgr2=0x7fa45c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a8d0 0x7fa45c1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 -- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa45c0b2250 msgr2=0x7fa45c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa45c0b2250 0x7fa45c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.144+0000 7fa45affd700 1 -- 172.21.15.155:0/1268553168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500094f0 con 0x7fa45c15a500 2024-08-17T02:27:53.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa45affd700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa450006fd0 tx=0x7fa450017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000bbe0 con 0x7fa45c15a500 2024-08-17T02:27:53.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450000c90 con 0x7fa45c15a500 2024-08-17T02:27:53.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c151c50 con 0x7fa45c15a500 2024-08-17T02:27:53.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450011630 con 0x7fa45c15a500 2024-08-17T02:27:53.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c152210 con 0x7fa45c15a500 2024-08-17T02:27:53.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c1529f0 con 0x7fa45c15a500 2024-08-17T02:27:53.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa450011a60 con 0x7fa45c15a500 2024-08-17T02:27:53.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 0x7fa448062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa45007e340 con 0x7fa45c15a500 2024-08-17T02:27:53.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.148+0000 7fa45b7fe700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 0x7fa448062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.152+0000 7fa45b7fe700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 0x7fa448062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009db0 tx=0x7fa44c0091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.152+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa45004e790 con 0x7fa45c15a500 2024-08-17T02:27:53.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.316+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa45c0645c0 con 0x7fa45c15a500 2024-08-17T02:27:53.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.316+0000 7fa4437fe700 1 -- 172.21.15.155:0/1268553168 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa450051db0 con 0x7fa45c15a500 2024-08-17T02:27:53.321 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 msgr2=0x7fa448062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 0x7fa448062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009db0 tx=0x7fa44c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 msgr2=0x7fa45c16a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa450006fd0 tx=0x7fa450017000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 shutdown_connections 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa448060860 0x7fa448062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa45c15a8d0 0x7fa45c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45c15a500 0x7fa45c16a340 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 --2- 172.21.15.155:0/1268553168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa45c0b2250 0x7fa45c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 >> 172.21.15.155:0/1268553168 conn(0x7fa45c0c9bf0 msgr2=0x7fa45c159280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 shutdown_connections 2024-08-17T02:27:53.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.320+0000 7fa461b57700 1 -- 172.21.15.155:0/1268553168 wait complete. 2024-08-17T02:27:53.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:53.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.448+0000 7f238bfff700 1 Processor -- start 2024-08-17T02:27:53.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.448+0000 7f238bfff700 1 -- start start 2024-08-17T02:27:53.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.448+0000 7f238bfff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 0x7f238c0aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c068ca0 0x7f238c066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f238c158b70 0x7f238c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c159530 con 0x7f238c158b70 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c067420 con 0x7f238c0688d0 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0ab0f0 con 0x7f238c068ca0 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f238c158b70 0x7f238c158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f238c158b70 0x7f238c158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52626/0 (socket says 172.21.15.155:52626) 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 -- 172.21.15.155:0/782797172 learned_addr learned my addr 172.21.15.155:0/782797172 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238a7fc700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c068ca0 0x7f238c066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238affd700 1 --2- 172.21.15.155:0/782797172 >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 0x7f238c0aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 -- 172.21.15.155:0/782797172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c068ca0 msgr2=0x7f238c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c068ca0 0x7f238c066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 -- 172.21.15.155:0/782797172 >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 msgr2=0x7f238c0aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 --2- 172.21.15.155:0/782797172 >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 0x7f238c0aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 -- 172.21.15.155:0/782797172 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0ab3d0 con 0x7f238c158b70 2024-08-17T02:27:53.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238affd700 1 --2- 172.21.15.155:0/782797172 >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 0x7f238c0aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:53.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238b7fe700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c158b70 0x7f238c158ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f238c069360 tx=0x7f237c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93205621936e6ca4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f2389ffb700 1 -- 172.21.15.155:0/782797172 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00e070 con 0x7f238c158b70 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f2389ffb700 1 -- 172.21.15.155:0/782797172 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00b970 con 0x7f238c158b70 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f2389ffb700 1 -- 172.21.15.155:0/782797172 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0092e0 con 0x7f238c158b70 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- 172.21.15.155:0/782797172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c158b70 msgr2=0x7f238c158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c158b70 0x7f238c158ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f238c069360 tx=0x7f237c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- 172.21.15.155:0/782797172 shutdown_connections 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c158b70 0x7f238c158ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- 172.21.15.155:0/782797172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c068ca0 0x7f238c066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 --2- 172.21.15.155:0/782797172 >> v2:172.21.15.189:3300/0 conn(0x7f238c0688d0 0x7f238c0aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- 172.21.15.155:0/782797172 >> 172.21.15.155:0/782797172 conn(0x7f238c06e310 msgr2=0x7f238c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- 172.21.15.155:0/782797172 shutdown_connections 2024-08-17T02:27:53.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.452+0000 7f238bfff700 1 -- 172.21.15.155:0/782797172 wait complete. 2024-08-17T02:27:53.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 Processor -- start 2024-08-17T02:27:53.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 -- start start 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c0688d0 0x7f238c0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c158b70 0x7f238c0b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c169040 con 0x7f238c068ca0 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b11b0 con 0x7f238c0688d0 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238bfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b1490 con 0x7f238c158b70 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52634/0 (socket says 172.21.15.155:52634) 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 -- 172.21.15.155:0/109796550 learned_addr learned my addr 172.21.15.155:0/109796550 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238affd700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c0688d0 0x7f238c0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238b7fe700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c158b70 0x7f238c0b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 -- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c158b70 msgr2=0x7f238c0b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c158b70 0x7f238c0b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 -- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c0688d0 msgr2=0x7f238c0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c0688d0 0x7f238c0cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 -- 172.21.15.155:0/109796550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009420 con 0x7f238c068ca0 2024-08-17T02:27:53.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.456+0000 7f238a7fc700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f237400ec80 tx=0x7f23740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400c850 con 0x7f238c068ca0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237400c9d0 con 0x7f238c068ca0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c009ae0 con 0x7f238c068ca0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400cd90 con 0x7f238c068ca0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c0b1a50 con 0x7f238c068ca0 2024-08-17T02:27:53.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c0638f0 con 0x7f238c068ca0 2024-08-17T02:27:53.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2374013680 con 0x7f238c068ca0 2024-08-17T02:27:53.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 0x7f236c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f237407ce50 con 0x7f238c068ca0 2024-08-17T02:27:53.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.460+0000 7f238affd700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 0x7f236c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.464+0000 7f238affd700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 0x7f236c062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2384009f40 tx=0x7f23840091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.468+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f237404d2a0 con 0x7f238c068ca0 2024-08-17T02:27:53.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.632+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f238c159010 con 0x7f238c068ca0 2024-08-17T02:27:53.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f2382ffd700 1 -- 172.21.15.155:0/109796550 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23740508c0 con 0x7f238c068ca0 2024-08-17T02:27:53.638 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 msgr2=0x7f236c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 0x7f236c062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2384009f40 tx=0x7f23840091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 msgr2=0x7f238c0b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f237400ec80 tx=0x7f23740091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 shutdown_connections 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f236c060860 0x7f236c062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f238c158b70 0x7f238c0b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f238c068ca0 0x7f238c0b0640 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 --2- 172.21.15.155:0/109796550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f238c0688d0 0x7f238c0cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 >> 172.21.15.155:0/109796550 conn(0x7f238c06e310 msgr2=0x7f238c15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 shutdown_connections 2024-08-17T02:27:53.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.636+0000 7f238bfff700 1 -- 172.21.15.155:0/109796550 wait complete. 2024-08-17T02:27:53.656 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:53.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 Processor -- start 2024-08-17T02:27:53.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 -- start start 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 0x7f9d98066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d98159480 0x7f9d98067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980ce210 con 0x7f9d980cd2b0 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980cba00 con 0x7f9d98159480 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9ece4700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980cdc90 con 0x7f9d981590b0 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9e4e3700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9d980cd2b0 0x7f9d9815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50672/0 (socket says 172.21.15.155:50672) 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9d4e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d98159480 0x7f9d98067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9e4e3700 1 -- 172.21.15.155:0/667469519 learned_addr learned my addr 172.21.15.155:0/667469519 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:53.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9dce2700 1 --2- 172.21.15.155:0/667469519 >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 0x7f9d98066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9cce0700 1 -- 172.21.15.155:0/667469519 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513259926 0 0) 0x7f9d980ce210 con 0x7f9d980cd2b0 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9cce0700 1 -- 172.21.15.155:0/667469519 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d84003570 con 0x7f9d980cd2b0 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9d4e1700 1 -- 172.21.15.155:0/667469519 >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 msgr2=0x7f9d98066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9d4e1700 1 --2- 172.21.15.155:0/667469519 >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 0x7f9d98066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9d4e1700 1 -- 172.21.15.155:0/667469519 >> v1:172.21.15.155:6789/0 conn(0x7f9d980cd2b0 legacy=0x7f9d9815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9d4e1700 1 -- 172.21.15.155:0/667469519 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980cb440 con 0x7f9d98159480 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.768+0000 7f9d9dce2700 1 --2- 172.21.15.155:0/667469519 >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 0x7f9d98066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:53.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9d4e1700 1 --2- 172.21.15.155:0/667469519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98067340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d98071780 tx=0x7f9d940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8835bf32e1493f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9cce0700 1 -- 172.21.15.155:0/667469519 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011630 con 0x7f9d98159480 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9cce0700 1 -- 172.21.15.155:0/667469519 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94011790 con 0x7f9d98159480 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9cce0700 1 -- 172.21.15.155:0/667469519 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011b30 con 0x7f9d98159480 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- 172.21.15.155:0/667469519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 msgr2=0x7f9d98067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/667469519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98067340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d98071780 tx=0x7f9d940091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- 172.21.15.155:0/667469519 shutdown_connections 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/667469519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98067340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/667469519 >> v2:172.21.15.189:3300/0 conn(0x7f9d981590b0 0x7f9d98066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- 172.21.15.155:0/667469519 >> 172.21.15.155:0/667469519 conn(0x7f9d980d0b90 msgr2=0x7f9d980ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- 172.21.15.155:0/667469519 shutdown_connections 2024-08-17T02:27:53.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- 172.21.15.155:0/667469519 wait complete. 2024-08-17T02:27:53.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 Processor -- start 2024-08-17T02:27:53.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.772+0000 7f9d9ece4700 1 -- start start 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d980cd2b0 0x7f9d980b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d981590b0 0x7f9d980aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98156530 con 0x7f9d98159480 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c91c0 con 0x7f9d980cd2b0 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c94a0 con 0x7f9d981590b0 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53532/0 (socket says 172.21.15.155:53532) 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 -- 172.21.15.155:0/293109323 learned_addr learned my addr 172.21.15.155:0/293109323 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:53.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9d4e1700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d981590b0 0x7f9d980aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9dce2700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d980cd2b0 0x7f9d980b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 -- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d981590b0 msgr2=0x7f9d980aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d981590b0 0x7f9d980aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 -- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d980cd2b0 msgr2=0x7f9d980b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d980cd2b0 0x7f9d980b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 -- 172.21.15.155:0/293109323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94009420 con 0x7f9d98159480 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9e4e3700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d90001460 tx=0x7f9d90001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000a890 con 0x7f9d98159480 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000a9f0 con 0x7f9d98159480 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d980c9780 con 0x7f9d98159480 2024-08-17T02:27:53.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000ad70 con 0x7f9d98159480 2024-08-17T02:27:53.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d980c9d40 con 0x7f9d98159480 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.776+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d98064330 con 0x7f9d98159480 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.780+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9d90007300 con 0x7f9d98159480 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.780+0000 7f9d8dffb700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 0x7f9d7c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.780+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d9007cf20 con 0x7f9d98159480 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.780+0000 7f9d9dce2700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 0x7f9d7c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.780+0000 7f9d9dce2700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 0x7f9d7c062d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006f00 tx=0x7f9d88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.788+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9d9004d3f0 con 0x7f9d98159480 2024-08-17T02:27:53.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.948+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d980c9f30 con 0x7f9d98159480 2024-08-17T02:27:53.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d8dffb700 1 -- 172.21.15.155:0/293109323 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d90050a10 con 0x7f9d98159480 2024-08-17T02:27:53.954 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:53.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 msgr2=0x7f9d7c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 0x7f9d7c062d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006f00 tx=0x7f9d88008040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 msgr2=0x7f9d98143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d90001460 tx=0x7f9d90001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 shutdown_connections 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9d7c060890 0x7f9d7c062d40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d98159480 0x7f9d98143470 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9d981590b0 0x7f9d980aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 --2- 172.21.15.155:0/293109323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d980cd2b0 0x7f9d980b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 >> 172.21.15.155:0/293109323 conn(0x7f9d980d0b90 msgr2=0x7f9d98067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 shutdown_connections 2024-08-17T02:27:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:53.952+0000 7f9d9ece4700 1 -- 172.21.15.155:0/293109323 wait complete. 2024-08-17T02:27:53.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:27:54.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.156+0000 7fb249cba700 1 Processor -- start 2024-08-17T02:27:54.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.156+0000 7fb249cba700 1 -- start start 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb244068ca0 0x7fb2440cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440c7750 con 0x7fb2440688d0 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440c6e20 con 0x7fb24406a470 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440cb220 con 0x7fb244068ca0 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb2437fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb2440688d0 0x7fb2440caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50678/0 (socket says 172.21.15.155:50678) 2024-08-17T02:27:54.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb2437fe700 1 -- 172.21.15.155:0/3271156850 learned_addr learned my addr 172.21.15.155:0/3271156850 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:54.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 --2- 172.21.15.155:0/3271156850 >> v2:172.21.15.189:3300/0 conn(0x7fb244068ca0 0x7fb2440cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821015970 0 0) 0x7fb2440c7750 con 0x7fb2440688d0 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb230003570 con 0x7fb2440688d0 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697006028 0 0) 0x7fb2440c6e20 con 0x7fb24406a470 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2440c7750 con 0x7fb24406a470 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560651858 0 0) 0x7fb230003570 con 0x7fb2440688d0 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 >> v2:172.21.15.189:3300/0 conn(0x7fb244068ca0 msgr2=0x7fb2440cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 --2- 172.21.15.155:0/3271156850 >> v2:172.21.15.189:3300/0 conn(0x7fb244068ca0 0x7fb2440cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 >> v1:172.21.15.189:6789/0 conn(0x7fb24406a470 legacy=0x7fb2440c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440c7100 con 0x7fb2440688d0 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fb234001470 con 0x7fb2440688d0 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 >> v1:172.21.15.155:6789/0 conn(0x7fb2440688d0 legacy=0x7fb2440caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb230003bf0 0x7fb230003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 0x7fb230004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2300051c0 0x7fb23000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440cb220 con 0x7fb230004810 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23000e2c0 con 0x7fb2300051c0 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23000e480 con 0x7fb230003bf0 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 0x7fb230004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb2437fe700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb230003bf0 0x7fb230003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb243fff700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2300051c0 0x7fb23000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 -- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb230003bf0 msgr2=0x7fb230003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb230003bf0 0x7fb230003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 -- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2300051c0 msgr2=0x7fb23000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2300051c0 0x7fb23000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 -- 172.21.15.155:0/3271156850 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230003570 con 0x7fb230004810 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb243fff700 1 -- 172.21.15.155:0/3271156850 reap_dead start 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb23bfff700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 0x7fb230004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009c00 tx=0x7fb22c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83f577b2c174cfa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00e710 con 0x7fb230004810 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00e870 con 0x7fb230004810 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb242ffd700 1 -- 172.21.15.155:0/3271156850 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00ec30 con 0x7fb230004810 2024-08-17T02:27:54.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 msgr2=0x7fb230004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 0x7fb230004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009c00 tx=0x7fb22c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- 172.21.15.155:0/3271156850 shutdown_connections 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 --2- 172.21.15.155:0/3271156850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb230004810 0x7fb230004c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- 172.21.15.155:0/3271156850 >> 172.21.15.155:0/3271156850 conn(0x7fb2440c9c20 msgr2=0x7fb24406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- 172.21.15.155:0/3271156850 shutdown_connections 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.160+0000 7fb249cba700 1 -- 172.21.15.155:0/3271156850 wait complete. 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 Processor -- start 2024-08-17T02:27:54.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- start start 2024-08-17T02:27:54.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 0x7fb244158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 0x7fb2440aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24416a470 con 0x7fb2440ac4a0 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440a9990 con 0x7fb230004810 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440a9c70 con 0x7fb2440c5f30 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53552/0 (socket says 172.21.15.155:53552) 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 -- 172.21.15.155:0/179377878 learned_addr learned my addr 172.21.15.155:0/179377878 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb2437fe700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 0x7fb244158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb243fff700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 0x7fb2440aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 -- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 msgr2=0x7fb2440aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 0x7fb2440aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 -- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 msgr2=0x7fb244158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 0x7fb244158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 -- 172.21.15.155:0/179377878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440a9f50 con 0x7fb2440ac4a0 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb243fff700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 0x7fb2440aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb2437fe700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 0x7fb244158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23bfff700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb23000e290 tx=0x7fb22c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c022070 con 0x7fb2440ac4a0 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00e9e0 con 0x7fb2440ac4a0 2024-08-17T02:27:54.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2440aa230 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c01c450 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.164+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb244158ca0 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2440645c0 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb22c01c880 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb23b7fe700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 0x7fb224062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb22c07e160 con 0x7fb2440ac4a0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb2437fe700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 0x7fb224062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.168+0000 7fb2437fe700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 0x7fb224062d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb2340015a0 tx=0x7fb234009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.176+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb22c04e6e0 con 0x7fb2440ac4a0 2024-08-17T02:27:54.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:54.400+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fb24416a470 con 0x7fb2440ac4a0 2024-08-17T02:27:55.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.104+0000 7fb23b7fe700 1 -- 172.21.15.155:0/179377878 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb22c006cb0 con 0x7fb2440ac4a0 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 msgr2=0x7fb224062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 0x7fb224062d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb2340015a0 tx=0x7fb234009040 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 msgr2=0x7fb2440c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb23000e290 tx=0x7fb22c01a000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 shutdown_connections 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb224060890 0x7fb224062d40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb2440c5f30 0x7fb2440aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2440ac4a0 0x7fb2440c59f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 --2- 172.21.15.155:0/179377878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb230004810 0x7fb244158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 >> 172.21.15.155:0/179377878 conn(0x7fb2440c9c20 msgr2=0x7fb2440c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 shutdown_connections 2024-08-17T02:27:55.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.108+0000 7fb249cba700 1 -- 172.21.15.155:0/179377878 wait complete. 2024-08-17T02:27:55.129 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:55.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 Processor -- start 2024-08-17T02:27:55.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 -- start start 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f689c159300 0x7f689c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 0x7f689c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c0cba90 con 0x7f689c1596d0 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0b2b60 con 0x7f689c159300 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f68a16da700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0cb160 con 0x7f689c067510 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f689a7fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f689c1596d0 0x7f689c066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50682/0 (socket says 172.21.15.155:50682) 2024-08-17T02:27:55.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f689a7fc700 1 -- 172.21.15.155:0/817034100 learned_addr learned my addr 172.21.15.155:0/817034100 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f689b7fe700 1 --2- 172.21.15.155:0/817034100 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 0x7f689c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.244+0000 7f689affd700 1 --2- 172.21.15.155:0/817034100 >> v2:172.21.15.189:3300/0 conn(0x7f689c159300 0x7f689c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f6899ffb700 1 -- 172.21.15.155:0/817034100 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646205870 0 0) 0x7f689c0cba90 con 0x7f689c1596d0 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f6899ffb700 1 -- 172.21.15.155:0/817034100 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6884003570 con 0x7f689c1596d0 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f689b7fe700 1 -- 172.21.15.155:0/817034100 >> v2:172.21.15.189:3300/0 conn(0x7f689c159300 msgr2=0x7f689c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f689b7fe700 1 --2- 172.21.15.155:0/817034100 >> v2:172.21.15.189:3300/0 conn(0x7f689c159300 0x7f689c0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f689b7fe700 1 -- 172.21.15.155:0/817034100 >> v1:172.21.15.155:6789/0 conn(0x7f689c1596d0 legacy=0x7f689c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f689b7fe700 1 -- 172.21.15.155:0/817034100 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0cb440 con 0x7f689c067510 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f689b7fe700 1 --2- 172.21.15.155:0/817034100 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 0x7f689c0cbf20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6894009e60 tx=0x7f6894009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb9b5fb75d21228 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f6899ffb700 1 -- 172.21.15.155:0/817034100 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400e070 con 0x7f689c067510 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f6899ffb700 1 -- 172.21.15.155:0/817034100 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400bab0 con 0x7f689c067510 2024-08-17T02:27:55.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f6899ffb700 1 -- 172.21.15.155:0/817034100 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400be30 con 0x7f689c067510 2024-08-17T02:27:55.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- 172.21.15.155:0/817034100 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 msgr2=0x7f689c0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 --2- 172.21.15.155:0/817034100 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 0x7f689c0cbf20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6894009e60 tx=0x7f6894009780 comp rx=0 tx=0).stop 2024-08-17T02:27:55.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- 172.21.15.155:0/817034100 shutdown_connections 2024-08-17T02:27:55.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 --2- 172.21.15.155:0/817034100 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c067510 0x7f689c0cbf20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 --2- 172.21.15.155:0/817034100 >> v2:172.21.15.189:3300/0 conn(0x7f689c159300 0x7f689c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- 172.21.15.155:0/817034100 >> 172.21.15.155:0/817034100 conn(0x7f689c0682c0 msgr2=0x7f689c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- 172.21.15.155:0/817034100 shutdown_connections 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- 172.21.15.155:0/817034100 wait complete. 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 Processor -- start 2024-08-17T02:27:55.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.248+0000 7f68a16da700 1 -- start start 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f689c067510 0x7f689c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c159300 0x7f689c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c15b760 con 0x7f689c1596d0 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c15ba40 con 0x7f689c067510 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c15bd20 con 0x7f689c159300 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53556/0 (socket says 172.21.15.155:53556) 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 -- 172.21.15.155:0/1281623376 learned_addr learned my addr 172.21.15.155:0/1281623376 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689a7fc700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c159300 0x7f689c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689affd700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f689c067510 0x7f689c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 -- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c159300 msgr2=0x7f689c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c159300 0x7f689c0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 -- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f689c067510 msgr2=0x7f689c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f689c067510 0x7f689c0c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 -- 172.21.15.155:0/1281623376 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894009a20 con 0x7f689c1596d0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f689b7fe700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6894013000 tx=0x7f6894019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894012e10 con 0x7f689c1596d0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894027470 con 0x7f689c1596d0 2024-08-17T02:27:55.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c15c000 con 0x7f689c1596d0 2024-08-17T02:27:55.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894027830 con 0x7f689c1596d0 2024-08-17T02:27:55.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0c4840 con 0x7f689c1596d0 2024-08-17T02:27:55.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.252+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c15c520 con 0x7f689c1596d0 2024-08-17T02:27:55.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.256+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6894024070 con 0x7f689c1596d0 2024-08-17T02:27:55.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.256+0000 7f6882ffd700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 0x7f6888062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.256+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f689407f190 con 0x7f689c1596d0 2024-08-17T02:27:55.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.256+0000 7f689affd700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 0x7f6888062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.256+0000 7f689affd700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 0x7f6888062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6890009db0 tx=0x7f68900091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.260+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f689404f5f0 con 0x7f689c1596d0 2024-08-17T02:27:55.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.428+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f689c0c4a30 con 0x7f689c1596d0 2024-08-17T02:27:55.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f6882ffd700 1 -- 172.21.15.155:0/1281623376 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f689c0c4a30 con 0x7f689c1596d0 2024-08-17T02:27:55.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 msgr2=0x7f6888062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 0x7f6888062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6890009db0 tx=0x7f68900091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 msgr2=0x7f689c0c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6894013000 tx=0x7f6894019000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 shutdown_connections 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6888060860 0x7f6888062d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c1596d0 0x7f689c0c6530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f689c159300 0x7f689c0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 --2- 172.21.15.155:0/1281623376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f689c067510 0x7f689c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 >> 172.21.15.155:0/1281623376 conn(0x7f689c0682c0 msgr2=0x7f689c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 shutdown_connections 2024-08-17T02:27:55.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.436+0000 7f68a16da700 1 -- 172.21.15.155:0/1281623376 wait complete. 2024-08-17T02:27:55.454 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:27:55.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:55.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:55.494 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:27:55.495 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-08-17T02:27:55.495 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:55.495 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:55.523 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:27:55.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:27:55.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.523 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:27:55.582 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi189.front.sepia.ceph.com... 2024-08-17T02:27:55.582 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:55.582 DEBUG:teuthology.orchestra.run.smithi189:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:27:55.607 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.607 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:27:55.642 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-08-17T02:27:55.643 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:55.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:55.658 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:27:55.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:27:55.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.661 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:27:55.666 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi189.front.sepia.ceph.com... 2024-08-17T02:27:55.666 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:55.666 DEBUG:teuthology.orchestra.run.smithi189:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:55.700 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:27:55.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:27:55.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.700 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:27:55.707 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:27:55.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:55.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 Processor -- start 2024-08-17T02:27:55.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 -- start start 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbe840af4d0 0x7fbe841557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe840686a0 0x7fbe84068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe84069040 con 0x7fbe841553e0 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe84155e30 con 0x7fbe840af4d0 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe83fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84156110 con 0x7fbe840686a0 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbe840af4d0 0x7fbe841557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbe840af4d0 0x7fbe841557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53568/0 (socket says 172.21.15.155:53568) 2024-08-17T02:27:55.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 -- 172.21.15.155:0/1501418369 learned_addr learned my addr 172.21.15.155:0/1501418369 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe837fe700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe840686a0 0x7fbe84068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 -- 172.21.15.155:0/1501418369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe840686a0 msgr2=0x7fbe84068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe840686a0 0x7fbe84068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 -- 172.21.15.155:0/1501418369 >> v1:172.21.15.189:6789/0 conn(0x7fbe841553e0 legacy=0x7fbe840b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 -- 172.21.15.155:0/1501418369 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe841563f0 con 0x7fbe840af4d0 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe827fc700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe841557b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00ab50 tx=0x7fbe6c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b1b70038073e32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe81ffb700 1 -- 172.21.15.155:0/1501418369 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00ca20 con 0x7fbe840af4d0 2024-08-17T02:27:55.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe81ffb700 1 -- 172.21.15.155:0/1501418369 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00cb80 con 0x7fbe840af4d0 2024-08-17T02:27:55.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.820+0000 7fbe81ffb700 1 -- 172.21.15.155:0/1501418369 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0183f0 con 0x7fbe840af4d0 2024-08-17T02:27:55.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 -- 172.21.15.155:0/1501418369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 msgr2=0x7fbe841557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe841557b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00ab50 tx=0x7fbe6c00a3f0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 -- 172.21.15.155:0/1501418369 shutdown_connections 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe840686a0 0x7fbe84068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 --2- 172.21.15.155:0/1501418369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe841557b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 -- 172.21.15.155:0/1501418369 >> 172.21.15.155:0/1501418369 conn(0x7fbe8406d800 msgr2=0x7fbe8406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 -- 172.21.15.155:0/1501418369 shutdown_connections 2024-08-17T02:27:55.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 -- 172.21.15.155:0/1501418369 wait complete. 2024-08-17T02:27:55.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.824+0000 7fbe83fff700 1 Processor -- start 2024-08-17T02:27:55.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 -- start start 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 0x7fbe8414c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe841553e0 0x7fbe8414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841498e0 con 0x7fbe840af4d0 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84168740 con 0x7fbe840686a0 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84168a20 con 0x7fbe841553e0 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe82ffd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 0x7fbe8414c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53582/0 (socket says 172.21.15.155:53582) 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 -- 172.21.15.155:0/4083940667 learned_addr learned my addr 172.21.15.155:0/4083940667 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:55.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe837fe700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe841553e0 0x7fbe8414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 -- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe841553e0 msgr2=0x7fbe8414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe841553e0 0x7fbe8414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 -- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 msgr2=0x7fbe8414c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 0x7fbe8414c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 -- 172.21.15.155:0/4083940667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c00a690 con 0x7fbe840af4d0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe82ffd700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 0x7fbe8414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe827fc700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00a430 tx=0x7fbe6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c023430 con 0x7fbe840af4d0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0235d0 con 0x7fbe840af4d0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe84168d00 con 0x7fbe840af4d0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.828+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c023990 con 0x7fbe840af4d0 2024-08-17T02:27:55.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8414cb90 con 0x7fbe840af4d0 2024-08-17T02:27:55.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe84154d40 con 0x7fbe840af4d0 2024-08-17T02:27:55.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe6c0103f0 con 0x7fbe840af4d0 2024-08-17T02:27:55.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe7affd700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 0x7fbe68062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe6c07f5e0 con 0x7fbe840af4d0 2024-08-17T02:27:55.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.832+0000 7fbe82ffd700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 0x7fbe68062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.836+0000 7fbe82ffd700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 0x7fbe68062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e40 tx=0x7fbe74009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:55.840+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe84154d40 con 0x7fbe840af4d0 2024-08-17T02:27:56.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.036+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe84069040 con 0x7fbe840af4d0 2024-08-17T02:27:56.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.036+0000 7fbe7affd700 1 -- 172.21.15.155:0/4083940667 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fbe84069040 con 0x7fbe840af4d0 2024-08-17T02:27:56.040 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:56.040 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 msgr2=0x7fbe68062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 0x7fbe68062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e40 tx=0x7fbe74009060 comp rx=0 tx=0).stop 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 msgr2=0x7fbe84154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00a430 tx=0x7fbe6c019000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 shutdown_connections 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbe68060890 0x7fbe68062d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbe841553e0 0x7fbe8414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe840af4d0 0x7fbe84154280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 --2- 172.21.15.155:0/4083940667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe840686a0 0x7fbe8414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 >> 172.21.15.155:0/4083940667 conn(0x7fbe8406d800 msgr2=0x7fbe840abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 shutdown_connections 2024-08-17T02:27:56.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.040+0000 7fbe83fff700 1 -- 172.21.15.155:0/4083940667 wait complete. 2024-08-17T02:27:56.043 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:56.053 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:56.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 Processor -- start 2024-08-17T02:27:56.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 -- start start 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc96c0aac50 0x7fc96c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c15b010 con 0x7fc96c0b3b30 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c15bc90 con 0x7fc96c0aac50 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc970b63700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c15b2f0 con 0x7fc96c15a2e0 2024-08-17T02:27:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc96c0aac50 0x7fc96c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc969d9b700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc96c0aac50 0x7fc96c15aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53592/0 (socket says 172.21.15.155:53592) 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc969d9b700 1 --2- 172.21.15.155:0/3052781158 >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:47410/0 (socket says 172.21.15.155:47410) 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 -- 172.21.15.155:0/3052781158 learned_addr learned my addr 172.21.15.155:0/3052781158 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96ad9d700 1 --1- 172.21.15.155:0/3052781158 >> v1:172.21.15.189:6789/0 conn(0x7fc96c0b3b30 0x7fc96c0b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:40064/0 (socket says 172.21.15.155:40064) 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 -- 172.21.15.155:0/3052781158 >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 msgr2=0x7fc96c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 --2- 172.21.15.155:0/3052781158 >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 -- 172.21.15.155:0/3052781158 >> v1:172.21.15.189:6789/0 conn(0x7fc96c0b3b30 legacy=0x7fc96c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 -- 172.21.15.155:0/3052781158 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c15b5d0 con 0x7fc96c0aac50 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc969d9b700 1 --2- 172.21.15.155:0/3052781158 >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96a59c700 1 --2- 172.21.15.155:0/3052781158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c15aa30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc96c08a590 tx=0x7fc95c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b896452fc0da5a68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96959a700 1 -- 172.21.15.155:0/3052781158 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c005c10 con 0x7fc96c0aac50 2024-08-17T02:27:56.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96959a700 1 -- 172.21.15.155:0/3052781158 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c005d70 con 0x7fc96c0aac50 2024-08-17T02:27:56.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.160+0000 7fc96959a700 1 -- 172.21.15.155:0/3052781158 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c006260 con 0x7fc96c0aac50 2024-08-17T02:27:56.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 -- 172.21.15.155:0/3052781158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 msgr2=0x7fc96c15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 --2- 172.21.15.155:0/3052781158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c15aa30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc96c08a590 tx=0x7fc95c009220 comp rx=0 tx=0).stop 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 -- 172.21.15.155:0/3052781158 shutdown_connections 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 --2- 172.21.15.155:0/3052781158 >> v2:172.21.15.189:3300/0 conn(0x7fc96c15a2e0 0x7fc96c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 --2- 172.21.15.155:0/3052781158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c15aa30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 -- 172.21.15.155:0/3052781158 >> 172.21.15.155:0/3052781158 conn(0x7fc96c0994d0 msgr2=0x7fc96c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 -- 172.21.15.155:0/3052781158 shutdown_connections 2024-08-17T02:27:56.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.164+0000 7fc970b63700 1 -- 172.21.15.155:0/3052781158 wait complete. 2024-08-17T02:27:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 Processor -- start 2024-08-17T02:27:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- start start 2024-08-17T02:27:56.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 0x7fc96c1691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15a2e0 0x7fc96c16c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15d0b0 con 0x7fc96c0aac50 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15dc30 con 0x7fc96c0b3b30 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c153930 con 0x7fc96c15a2e0 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53602/0 (socket says 172.21.15.155:53602) 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 -- 172.21.15.155:0/1987417552 learned_addr learned my addr 172.21.15.155:0/1987417552 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96ad9d700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15a2e0 0x7fc96c16c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc969d9b700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 0x7fc96c1691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 -- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15a2e0 msgr2=0x7fc96c16c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15a2e0 0x7fc96c16c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 -- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 msgr2=0x7fc96c1691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 0x7fc96c1691b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 -- 172.21.15.155:0/1987417552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954009a20 con 0x7fc96c0aac50 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc969d9b700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 0x7fc96c1691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc96a59c700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b0e0 tx=0x7fc95c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00b740 con 0x7fc96c0aac50 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c020070 con 0x7fc96c0aac50 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bb10 con 0x7fc96c0aac50 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c009480 con 0x7fc96c0aac50 2024-08-17T02:27:56.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.168+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c15d5e0 con 0x7fc96c0aac50 2024-08-17T02:27:56.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0645c0 con 0x7fc96c0aac50 2024-08-17T02:27:56.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc95c022030 con 0x7fc96c0aac50 2024-08-17T02:27:56.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc9627fc700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 0x7fc94c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc95c07e750 con 0x7fc96c0aac50 2024-08-17T02:27:56.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc969d9b700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 0x7fc94c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.172+0000 7fc969d9b700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 0x7fc94c062d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc954009fd0 tx=0x7fc95400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.184+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc95c04eb00 con 0x7fc96c0aac50 2024-08-17T02:27:56.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.344+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc96c1594b0 con 0x7fc96c0aac50 2024-08-17T02:27:56.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc9627fc700 1 -- 172.21.15.155:0/1987417552 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fc95c052120 con 0x7fc96c0aac50 2024-08-17T02:27:56.351 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:56.351 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:56.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 msgr2=0x7fc94c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 0x7fc94c062d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc954009fd0 tx=0x7fc95400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 msgr2=0x7fc96c1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b0e0 tx=0x7fc95c016000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 shutdown_connections 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc94c060890 0x7fc94c062d40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc96c15a2e0 0x7fc96c16c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc96c0b3b30 0x7fc96c1691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 --2- 172.21.15.155:0/1987417552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0aac50 0x7fc96c1533f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 >> 172.21.15.155:0/1987417552 conn(0x7fc96c0994d0 msgr2=0x7fc96c159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 shutdown_connections 2024-08-17T02:27:56.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.348+0000 7fc970b63700 1 -- 172.21.15.155:0/1987417552 wait complete. 2024-08-17T02:27:56.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:20.371090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:21.020182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:56.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:56.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 Processor -- start 2024-08-17T02:27:56.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 -- start start 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe9c40a9040 0x7fe9c40a9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9c40acf00 0x7fe9c406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40aa890 con 0x7fe9c40adf20 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40aa030 con 0x7fe9c40acf00 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9cb649700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40ad360 con 0x7fe9c40a9040 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9c40acf00 0x7fe9c406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9c40acf00 0x7fe9c406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53614/0 (socket says 172.21.15.155:53614) 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 -- 172.21.15.155:0/647107944 learned_addr learned my addr 172.21.15.155:0/647107944 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c93e5700 1 --2- 172.21.15.155:0/647107944 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40a9040 0x7fe9c40a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 -- 172.21.15.155:0/647107944 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40a9040 msgr2=0x7fe9c40a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 --2- 172.21.15.155:0/647107944 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40a9040 0x7fe9c40a9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 -- 172.21.15.155:0/647107944 >> v1:172.21.15.189:6789/0 conn(0x7fe9c40adf20 legacy=0x7fe9c41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 -- 172.21.15.155:0/647107944 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40ae730 con 0x7fe9c40acf00 2024-08-17T02:27:56.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9c8be4700 1 --2- 172.21.15.155:0/647107944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c406d2a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00099b0 tx=0x7fe9c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e6b7c762bff734 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9b7fff700 1 -- 172.21.15.155:0/647107944 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000b820 con 0x7fe9c40acf00 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9b7fff700 1 -- 172.21.15.155:0/647107944 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000b980 con 0x7fe9c40acf00 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.476+0000 7fe9b7fff700 1 -- 172.21.15.155:0/647107944 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000bd20 con 0x7fe9c40acf00 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- 172.21.15.155:0/647107944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 msgr2=0x7fe9c406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- 172.21.15.155:0/647107944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c406d2a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00099b0 tx=0x7fe9c0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- 172.21.15.155:0/647107944 shutdown_connections 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- 172.21.15.155:0/647107944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c406d2a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- 172.21.15.155:0/647107944 >> v2:172.21.15.189:3300/0 conn(0x7fe9c40a9040 0x7fe9c40a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- 172.21.15.155:0/647107944 >> 172.21.15.155:0/647107944 conn(0x7fe9c4066e00 msgr2=0x7fe9c4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- 172.21.15.155:0/647107944 shutdown_connections 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- 172.21.15.155:0/647107944 wait complete. 2024-08-17T02:27:56.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 Processor -- start 2024-08-17T02:27:56.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- start start 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40a9040 0x7fe9c4147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40adf20 0x7fe9c4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c416a560 con 0x7fe9c40acf00 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4097d10 con 0x7fe9c40a9040 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9cb649700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c416a280 con 0x7fe9c40adf20 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9c8be4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9c93e5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40a9040 0x7fe9c4147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9c8be4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53616/0 (socket says 172.21.15.155:53616) 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9c8be4700 1 -- 172.21.15.155:0/2120540434 learned_addr learned my addr 172.21.15.155:0/2120540434 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.480+0000 7fe9c9be6700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40adf20 0x7fe9c4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 -- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40adf20 msgr2=0x7fe9c4158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40adf20 0x7fe9c4158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 -- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40a9040 msgr2=0x7fe9c4147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40a9040 0x7fe9c4147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 -- 172.21.15.155:0/2120540434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00094f0 con 0x7fe9c40acf00 2024-08-17T02:27:56.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9c8be4700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009290 tx=0x7fe9c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000bd00 con 0x7fe9c40acf00 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0024440 con 0x7fe9c40acf00 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c40c53b0 con 0x7fe9c40acf00 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00247e0 con 0x7fe9c40acf00 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c40c5970 con 0x7fe9c40acf00 2024-08-17T02:27:56.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.484+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c40c5210 con 0x7fe9c40acf00 2024-08-17T02:27:56.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.488+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe9c002d440 con 0x7fe9c40acf00 2024-08-17T02:27:56.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.488+0000 7fe9b57fa700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 0x7fe9a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.488+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9c007e570 con 0x7fe9c40acf00 2024-08-17T02:27:56.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.488+0000 7fe9c93e5700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 0x7fe9a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.488+0000 7fe9c93e5700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 0x7fe9a8062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8006fd0 tx=0x7fe9b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.496+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe9c40c5210 con 0x7fe9c40acf00 2024-08-17T02:27:56.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.652+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9c40c5210 con 0x7fe9c40acf00 2024-08-17T02:27:56.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.652+0000 7fe9b57fa700 1 -- 172.21.15.155:0/2120540434 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9c40c5210 con 0x7fe9c40acf00 2024-08-17T02:27:56.656 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 msgr2=0x7fe9a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 0x7fe9a8062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8006fd0 tx=0x7fe9b8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 msgr2=0x7fe9c41588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009290 tx=0x7fe9c0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 shutdown_connections 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe9a8060860 0x7fe9a8062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe9c40adf20 0x7fe9c4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c40acf00 0x7fe9c41588d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 --2- 172.21.15.155:0/2120540434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9c40a9040 0x7fe9c4147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 >> 172.21.15.155:0/2120540434 conn(0x7fe9c4066e00 msgr2=0x7fe9c4155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 shutdown_connections 2024-08-17T02:27:56.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.656+0000 7fe9cb649700 1 -- 172.21.15.155:0/2120540434 wait complete. 2024-08-17T02:27:56.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:56.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 Processor -- start 2024-08-17T02:27:56.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 -- start start 2024-08-17T02:27:56.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9988156d80 0x7f99880b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99880cbd60 0x7f99880ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880ca700 con 0x7f9988157150 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880b21c0 con 0x7f99880cbd60 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9987fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880b24a0 con 0x7f9988156d80 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99880cbd60 0x7f99880ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99877fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9988157150 0x7f99880cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50692/0 (socket says 172.21.15.155:50692) 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99877fe700 1 -- 172.21.15.155:0/2188163836 learned_addr learned my addr 172.21.15.155:0/2188163836 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:56.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9986ffd700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9988156d80 0x7f99880b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 -- 172.21.15.155:0/2188163836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9988156d80 msgr2=0x7f99880b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9988156d80 0x7f99880b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 -- 172.21.15.155:0/2188163836 >> v1:172.21.15.155:6789/0 conn(0x7f9988157150 legacy=0x7f99880cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 -- 172.21.15.155:0/2188163836 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880ca390 con 0x7f99880cbd60 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9985ffb700 1 -- 172.21.15.155:0/2188163836 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570248226 0 0) 0x7f99880ca700 con 0x7f9988157150 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f99867fc700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99880cbd60 0x7f99880ac070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f997c0098e0 tx=0x7f997c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352546b96ffaea2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9985ffb700 1 -- 172.21.15.155:0/2188163836 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00b640 con 0x7f99880cbd60 2024-08-17T02:27:56.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9985ffb700 1 -- 172.21.15.155:0/2188163836 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00b7a0 con 0x7f99880cbd60 2024-08-17T02:27:56.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.776+0000 7f9985ffb700 1 -- 172.21.15.155:0/2188163836 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00bb40 con 0x7f99880cbd60 2024-08-17T02:27:56.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- 172.21.15.155:0/2188163836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99880cbd60 msgr2=0x7f99880ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99880cbd60 0x7f99880ac070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f997c0098e0 tx=0x7f997c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- 172.21.15.155:0/2188163836 shutdown_connections 2024-08-17T02:27:56.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99880cbd60 0x7f99880ac070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 --2- 172.21.15.155:0/2188163836 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9988156d80 0x7f99880b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- 172.21.15.155:0/2188163836 >> 172.21.15.155:0/2188163836 conn(0x7f998806e310 msgr2=0x7f998806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- 172.21.15.155:0/2188163836 shutdown_connections 2024-08-17T02:27:56.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- 172.21.15.155:0/2188163836 wait complete. 2024-08-17T02:27:56.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 Processor -- start 2024-08-17T02:27:56.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.780+0000 7f9987fff700 1 -- start start 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99880cbd60 0x7f99880c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988156d80 0x7f9988166e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998815cc00 con 0x7f9988157150 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988152bc0 con 0x7f9988156d80 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99881528e0 con 0x7f99880cbd60 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53620/0 (socket says 172.21.15.155:53620) 2024-08-17T02:27:56.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 -- 172.21.15.155:0/58116486 learned_addr learned my addr 172.21.15.155:0/58116486 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9986ffd700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99880cbd60 0x7f99880c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99867fc700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988156d80 0x7f9988166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 -- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99880cbd60 msgr2=0x7f99880c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99880cbd60 0x7f99880c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 -- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988156d80 msgr2=0x7f9988166e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988156d80 0x7f9988166e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 -- 172.21.15.155:0/58116486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c009420 con 0x7f9988157150 2024-08-17T02:27:56.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f99877fe700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f998000cbc0 tx=0x7f9980001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000a7e0 con 0x7f9988157150 2024-08-17T02:27:56.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998000a940 con 0x7f9988157150 2024-08-17T02:27:56.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000ad00 con 0x7f9988157150 2024-08-17T02:27:56.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998815c5b0 con 0x7f9988157150 2024-08-17T02:27:56.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.784+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988150730 con 0x7f9988157150 2024-08-17T02:27:56.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998815cd70 con 0x7f9988157150 2024-08-17T02:27:56.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9980007300 con 0x7f9988157150 2024-08-17T02:27:56.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f996effd700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 0x7f9974062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f998007cd50 con 0x7f9988157150 2024-08-17T02:27:56.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f9986ffd700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 0x7f9974062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.788+0000 7f9986ffd700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 0x7f9974062de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9978009db0 tx=0x7f99780091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.796+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f998004d300 con 0x7f9988157150 2024-08-17T02:27:56.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99880638f0 con 0x7f9988157150 2024-08-17T02:27:56.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f996effd700 1 -- 172.21.15.155:0/58116486 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f998000ae60 con 0x7f9988157150 2024-08-17T02:27:56.959 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 msgr2=0x7f9974062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 0x7f9974062de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9978009db0 tx=0x7f99780091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 msgr2=0x7f9988167340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f998000cbc0 tx=0x7f9980001980 comp rx=0 tx=0).stop 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 shutdown_connections 2024-08-17T02:27:56.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9974060930 0x7f9974062de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9988157150 0x7f9988167340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988156d80 0x7f9988166e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 --2- 172.21.15.155:0/58116486 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f99880cbd60 0x7f99880c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 >> 172.21.15.155:0/58116486 conn(0x7f998806e310 msgr2=0x7f998806b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 shutdown_connections 2024-08-17T02:27:56.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:56.956+0000 7f9987fff700 1 -- 172.21.15.155:0/58116486 wait complete. 2024-08-17T02:27:56.973 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:57.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.084+0000 7fabd573f700 1 Processor -- start 2024-08-17T02:27:57.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.084+0000 7fabd573f700 1 -- start start 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 0x7fabd00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00cba90 con 0x7fabd015dbc0 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00b2b60 con 0x7fabd0159300 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00cb160 con 0x7fabd01596d0 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabceffd700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 0x7fabd00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:50584/0 (socket says 172.21.15.155:50584) 2024-08-17T02:27:57.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcf7fe700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fabd015dbc0 0x7fabd00afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:40082/0 (socket says 172.21.15.155:40082) 2024-08-17T02:27:57.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 -- 172.21.15.155:0/1769745695 learned_addr learned my addr 172.21.15.155:0/1769745695 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcdffb700 1 -- 172.21.15.155:0/1769745695 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960834678 0 0) 0x7fabd00cba90 con 0x7fabd015dbc0 2024-08-17T02:27:57.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcdffb700 1 -- 172.21.15.155:0/1769745695 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb8003570 con 0x7fabd015dbc0 2024-08-17T02:27:57.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 -- 172.21.15.155:0/1769745695 >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 msgr2=0x7fabd00b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 --2- 172.21.15.155:0/1769745695 >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 0x7fabd00b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 -- 172.21.15.155:0/1769745695 >> v1:172.21.15.189:6789/0 conn(0x7fabd015dbc0 legacy=0x7fabd00afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 -- 172.21.15.155:0/1769745695 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00cb440 con 0x7fabd01596d0 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabceffd700 1 --2- 172.21.15.155:0/1769745695 >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 0x7fabd00b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabce7fc700 1 --2- 172.21.15.155:0/1769745695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabc00099b0 tx=0x7fabc0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00af1a63cd531df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcdffb700 1 -- 172.21.15.155:0/1769745695 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000b680 con 0x7fabd01596d0 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcdffb700 1 -- 172.21.15.155:0/1769745695 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000b7e0 con 0x7fabd01596d0 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabcdffb700 1 -- 172.21.15.155:0/1769745695 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000bb60 con 0x7fabd01596d0 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- 172.21.15.155:0/1769745695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 msgr2=0x7fabd0066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 --2- 172.21.15.155:0/1769745695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabc00099b0 tx=0x7fabc0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- 172.21.15.155:0/1769745695 shutdown_connections 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 --2- 172.21.15.155:0/1769745695 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd01596d0 0x7fabd0066e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 --2- 172.21.15.155:0/1769745695 >> v2:172.21.15.189:3300/0 conn(0x7fabd0159300 0x7fabd00b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- 172.21.15.155:0/1769745695 >> 172.21.15.155:0/1769745695 conn(0x7fabd00682c0 msgr2=0x7fabd00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- 172.21.15.155:0/1769745695 shutdown_connections 2024-08-17T02:27:57.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.088+0000 7fabd573f700 1 -- 172.21.15.155:0/1769745695 wait complete. 2024-08-17T02:27:57.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 Processor -- start 2024-08-17T02:27:57.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 -- start start 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd0159300 0x7fabd00c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabd015dbc0 0x7fabd00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c5a10 con 0x7fabd01596d0 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c78b0 con 0x7fabd015dbc0 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabd573f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c9480 con 0x7fabd0159300 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53634/0 (socket says 172.21.15.155:53634) 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 -- 172.21.15.155:0/1159890445 learned_addr learned my addr 172.21.15.155:0/1159890445 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabceffd700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd0159300 0x7fabd00c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabcf7fe700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabd015dbc0 0x7fabd00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 -- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd0159300 msgr2=0x7fabd00c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd0159300 0x7fabd00c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 -- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabd015dbc0 msgr2=0x7fabd00b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabd015dbc0 0x7fabd00b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 -- 172.21.15.155:0/1159890445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009420 con 0x7fabd01596d0 2024-08-17T02:27:57.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.092+0000 7fabce7fc700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabc0006fd0 tx=0x7fabc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000b950 con 0x7fabd01596d0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000bab0 con 0x7fabd01596d0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc001a6a0 con 0x7fabd01596d0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc00094f0 con 0x7fabd01596d0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd00c5c50 con 0x7fabd01596d0 2024-08-17T02:27:57.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fabc001aa50 con 0x7fabd01596d0 2024-08-17T02:27:57.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd00b1af0 con 0x7fabd01596d0 2024-08-17T02:27:57.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 0x7fabbc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabc007e720 con 0x7fabd01596d0 2024-08-17T02:27:57.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.096+0000 7fabceffd700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 0x7fabbc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.100+0000 7fabceffd700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 0x7fabbc062d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ea0 tx=0x7fabc40091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.104+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fabd00b1af0 con 0x7fabd01596d0 2024-08-17T02:27:57.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.268+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabd00cd250 con 0x7fabd01596d0 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.268+0000 7fabb6ffd700 1 -- 172.21.15.155:0/1159890445 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabd00cd250 con 0x7fabd01596d0 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 msgr2=0x7fabbc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 0x7fabbc062d40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ea0 tx=0x7fabc40091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 msgr2=0x7fabd01506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabc0006fd0 tx=0x7fabc0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 shutdown_connections 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fabbc060890 0x7fabbc062d40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabd015dbc0 0x7fabd00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd01596d0 0x7fabd01506b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 --2- 172.21.15.155:0/1159890445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabd0159300 0x7fabd00c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 >> 172.21.15.155:0/1159890445 conn(0x7fabd00682c0 msgr2=0x7fabd01574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 shutdown_connections 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.272+0000 7fabd573f700 1 -- 172.21.15.155:0/1159890445 wait complete. 2024-08-17T02:27:57.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:57.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.384+0000 7f6d5744e700 1 Processor -- start 2024-08-17T02:27:57.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.384+0000 7f6d5744e700 1 -- start start 2024-08-17T02:27:57.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d500a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d501598a0 0x7f6d500b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500b00d0 con 0x7f6d500a8f50 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500b11b0 con 0x7f6d501598a0 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50159d40 con 0x7f6d500af030 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d501598a0 0x7f6d500b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d501598a0 0x7f6d500b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53644/0 (socket says 172.21.15.155:53644) 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 -- 172.21.15.155:0/2863661389 learned_addr learned my addr 172.21.15.155:0/2863661389 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d549e9700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d500a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 -- 172.21.15.155:0/2863661389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 msgr2=0x7f6d500a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d500a9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 -- 172.21.15.155:0/2863661389 >> v1:172.21.15.189:6789/0 conn(0x7f6d500a8f50 legacy=0x7f6d500b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 -- 172.21.15.155:0/2863661389 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500af4c0 con 0x7f6d501598a0 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d559eb700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d501598a0 0x7f6d500b0c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d480099b0 tx=0x7f6d48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cae6aba8b0bbc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d4ffff700 1 -- 172.21.15.155:0/2863661389 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009ea0 con 0x7f6d501598a0 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d4ffff700 1 -- 172.21.15.155:0/2863661389 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800b860 con 0x7f6d501598a0 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d4ffff700 1 -- 172.21.15.155:0/2863661389 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800bc00 con 0x7f6d501598a0 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- 172.21.15.155:0/2863661389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d501598a0 msgr2=0x7f6d500b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d501598a0 0x7f6d500b0c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d480099b0 tx=0x7f6d48009250 comp rx=0 tx=0).stop 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- 172.21.15.155:0/2863661389 shutdown_connections 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d500a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 --2- 172.21.15.155:0/2863661389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d501598a0 0x7f6d500b0c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- 172.21.15.155:0/2863661389 >> 172.21.15.155:0/2863661389 conn(0x7f6d50066e00 msgr2=0x7f6d50067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- 172.21.15.155:0/2863661389 shutdown_connections 2024-08-17T02:27:57.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.388+0000 7f6d5744e700 1 -- 172.21.15.155:0/2863661389 wait complete. 2024-08-17T02:27:57.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 Processor -- start 2024-08-17T02:27:57.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 -- start start 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d50136720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d501598a0 0x7f6d50069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50099770 con 0x7f6d500a8f50 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50141f30 con 0x7f6d501598a0 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d5744e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50098b60 con 0x7f6d500af030 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53648/0 (socket says 172.21.15.155:53648) 2024-08-17T02:27:57.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 -- 172.21.15.155:0/340894878 learned_addr learned my addr 172.21.15.155:0/340894878 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d549e9700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d50136720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d559eb700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d501598a0 0x7f6d50069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 -- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 msgr2=0x7f6d50136720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d50136720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 -- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d501598a0 msgr2=0x7f6d50069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d501598a0 0x7f6d50069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 -- 172.21.15.155:0/340894878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480094f0 con 0x7f6d500a8f50 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d551ea700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c4e0 tx=0x7f6d4400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44011590 con 0x7f6d500a8f50 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.392+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d44011710 con 0x7f6d500a8f50 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44011ad0 con 0x7f6d500a8f50 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d50098e40 con 0x7f6d500a8f50 2024-08-17T02:27:57.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50099400 con 0x7f6d500a8f50 2024-08-17T02:27:57.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d500645c0 con 0x7f6d500a8f50 2024-08-17T02:27:57.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6d4401b3b0 con 0x7f6d500a8f50 2024-08-17T02:27:57.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.396+0000 7f6d4d7fa700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 0x7f6d3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.400+0000 7f6d549e9700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 0x7f6d3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.400+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d4407bf60 con 0x7f6d500a8f50 2024-08-17T02:27:57.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.400+0000 7f6d549e9700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 0x7f6d3c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d500ae230 tx=0x7f6d4000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.404+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6d4404c3b0 con 0x7f6d500a8f50 2024-08-17T02:27:57.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.600+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d5006f360 con 0x7f6d500a8f50 2024-08-17T02:27:57.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.600+0000 7f6d4d7fa700 1 -- 172.21.15.155:0/340894878 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f6d44017020 con 0x7f6d500a8f50 2024-08-17T02:27:57.604 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:57.604 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 msgr2=0x7f6d3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 0x7f6d3c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d500ae230 tx=0x7f6d4000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 msgr2=0x7f6d50098460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c4e0 tx=0x7f6d4400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 shutdown_connections 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6d3c060860 0x7f6d3c062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d501598a0 0x7f6d50069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d500af030 0x7f6d50136720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 --2- 172.21.15.155:0/340894878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d500a8f50 0x7f6d50098460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 >> 172.21.15.155:0/340894878 conn(0x7f6d50066e00 msgr2=0x7f6d500671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 shutdown_connections 2024-08-17T02:27:57.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.604+0000 7f6d5744e700 1 -- 172.21.15.155:0/340894878 wait complete. 2024-08-17T02:27:57.608 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:57.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 Processor -- start 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- start start 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b440688d0 0x7f8b44068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b440cc160 0x7f8b440caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 0x7f8b4406a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440cb220 con 0x7f8b440cc160 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440c7750 con 0x7f8b44066e00 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440caf80 con 0x7f8b440688d0 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b440cc160 0x7f8b440caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b440cc160 0x7f8b440caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53662/0 (socket says 172.21.15.155:53662) 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 -- 172.21.15.155:0/1089713071 learned_addr learned my addr 172.21.15.155:0/1089713071 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4937b700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b440688d0 0x7f8b44068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b49b7c700 1 --2- 172.21.15.155:0/1089713071 >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 0x7f8b4406a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 -- 172.21.15.155:0/1089713071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b440688d0 msgr2=0x7f8b44068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b440688d0 0x7f8b44068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 -- 172.21.15.155:0/1089713071 >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 msgr2=0x7f8b4406a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 --2- 172.21.15.155:0/1089713071 >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 0x7f8b4406a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 -- 172.21.15.155:0/1089713071 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440c6e20 con 0x7f8b440cc160 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b49b7c700 1 --2- 172.21.15.155:0/1089713071 >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 0x7f8b4406a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b48b7a700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440caa40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b440abb10 tx=0x7f8b40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f168bbb9e05a3b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b3bfff700 1 -- 172.21.15.155:0/1089713071 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000b860 con 0x7f8b440cc160 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b3bfff700 1 -- 172.21.15.155:0/1089713071 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000b9c0 con 0x7f8b440cc160 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b3bfff700 1 -- 172.21.15.155:0/1089713071 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000bd60 con 0x7f8b440cc160 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- 172.21.15.155:0/1089713071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 msgr2=0x7f8b440caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440caa40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b440abb10 tx=0x7f8b40009250 comp rx=0 tx=0).stop 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- 172.21.15.155:0/1089713071 shutdown_connections 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440caa40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/1089713071 >> v2:172.21.15.189:3300/0 conn(0x7f8b44066e00 0x7f8b4406a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/1089713071 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b440688d0 0x7f8b44068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- 172.21.15.155:0/1089713071 >> 172.21.15.155:0/1089713071 conn(0x7f8b440c9c20 msgr2=0x7f8b4406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- 172.21.15.155:0/1089713071 shutdown_connections 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.724+0000 7f8b4b5df700 1 -- 172.21.15.155:0/1089713071 wait complete. 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 Processor -- start 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 -- start start 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b44066e00 0x7f8b44157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 0x7f8b441558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440ae830 con 0x7f8b440cc160 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44156bf0 con 0x7f8b440688d0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4b5df700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44155fe0 con 0x7f8b44066e00 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53674/0 (socket says 172.21.15.155:53674) 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 -- 172.21.15.155:0/3440018578 learned_addr learned my addr 172.21.15.155:0/3440018578 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b4937b700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b44066e00 0x7f8b44157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b48b7a700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 0x7f8b441558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 -- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b44066e00 msgr2=0x7f8b44157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b44066e00 0x7f8b44157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 -- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 msgr2=0x7f8b441558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 0x7f8b441558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 -- 172.21.15.155:0/3440018578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400094f0 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b48b7a700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 0x7f8b441558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.728+0000 7f8b49b7c700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cef0 tx=0x7f8b3c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00add0 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c016420 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b441562c0 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0167e0 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b44156880 con 0x7f8b440cc160 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44156da0 con 0x7f8b440cc160 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8b3c016bd0 con 0x7f8b440cc160 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 0x7f8b28062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b3c012070 con 0x7f8b440cc160 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.732+0000 7f8b4937b700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 0x7f8b28062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.736+0000 7f8b4937b700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 0x7f8b28062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b34006fd0 tx=0x7f8b34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.744+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8b44156da0 con 0x7f8b440cc160 2024-08-17T02:27:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.912+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b44156da0 con 0x7f8b440cc160 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.912+0000 7f8b397fa700 1 -- 172.21.15.155:0/3440018578 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8b44156da0 con 0x7f8b440cc160 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 msgr2=0x7f8b28062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 0x7f8b28062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b34006fd0 tx=0x7f8b34008040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 msgr2=0x7f8b440ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cef0 tx=0x7f8b3c007860 comp rx=0 tx=0).stop 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 shutdown_connections 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8b28060860 0x7f8b28062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b440cc160 0x7f8b440ae2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b440688d0 0x7f8b441558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 --2- 172.21.15.155:0/3440018578 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8b44066e00 0x7f8b44157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 >> 172.21.15.155:0/3440018578 conn(0x7f8b440c9c20 msgr2=0x7f8b4406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 shutdown_connections 2024-08-17T02:27:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:57.916+0000 7f8b4b5df700 1 -- 172.21.15.155:0/3440018578 wait complete. 2024-08-17T02:27:57.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:57.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:58.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.036+0000 7f977d62f700 1 Processor -- start 2024-08-17T02:27:58.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.036+0000 7f977d62f700 1 -- start start 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f97780b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f97780ad7c0 0x7f97780aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780af2b0 con 0x7f977806df10 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97780adc10 con 0x7f97780ad7c0 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780af590 con 0x7f9778155d20 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977ce2e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f977806df10 0x7f97781599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50702/0 (socket says 172.21.15.155:50702) 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977ce2e700 1 -- 172.21.15.155:0/2658320535 learned_addr learned my addr 172.21.15.155:0/2658320535 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 --2- 172.21.15.155:0/2658320535 >> v2:172.21.15.189:3300/0 conn(0x7f97780ad7c0 0x7f97780aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9777fff700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f97780b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030906988 0 0) 0x7f97780af2b0 con 0x7f977806df10 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9758003570 con 0x7f977806df10 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 -- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 msgr2=0x7f97780b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f97780b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936593391 0 0) 0x7f9758003570 con 0x7f977806df10 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 -- 172.21.15.155:0/2658320535 >> v1:172.21.15.155:6789/0 conn(0x7f977806df10 legacy=0x7f97781599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 -- 172.21.15.155:0/2658320535 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780af870 con 0x7f97780ad7c0 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f97777fe700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97780aea80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9760009e60 tx=0x7f9760009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa44cd9d8d2792f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000e070 con 0x7f97780ad7c0 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000b7a0 con 0x7f97780ad7c0 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f9776ffd700 1 -- 172.21.15.155:0/2658320535 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770001470 con 0x7f97780ad7c0 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 msgr2=0x7f97780aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97780aea80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9760009e60 tx=0x7f9760009780 comp rx=0 tx=0).stop 2024-08-17T02:27:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- 172.21.15.155:0/2658320535 shutdown_connections 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97780aea80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 --2- 172.21.15.155:0/2658320535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f97780b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- 172.21.15.155:0/2658320535 >> 172.21.15.155:0/2658320535 conn(0x7f97780678d0 msgr2=0x7f9778067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- 172.21.15.155:0/2658320535 shutdown_connections 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.040+0000 7f977d62f700 1 -- 172.21.15.155:0/2658320535 wait complete. 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 Processor -- start 2024-08-17T02:27:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- start start 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97781560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f9778156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977814e8d0 con 0x7f977806df10 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977814dfa0 con 0x7f97780ad7c0 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977814e280 con 0x7f9778155d20 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53678/0 (socket says 172.21.15.155:53678) 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 -- 172.21.15.155:0/2318277620 learned_addr learned my addr 172.21.15.155:0/2318277620 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f97777fe700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97781560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977ce2e700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f9778156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 -- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 msgr2=0x7f9778156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f9778156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 -- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 msgr2=0x7f97781560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97781560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 -- 172.21.15.155:0/2318277620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a20 con 0x7f977806df10 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f9777fff700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f976800ec80 tx=0x7f97680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800c850 con 0x7f977806df10 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977814e560 con 0x7f977806df10 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800c9b0 con 0x7f977806df10 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9778142180 con 0x7f977806df10 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.044+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800cd30 con 0x7f977806df10 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97780643a0 con 0x7f977806df10 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9768013680 con 0x7f977806df10 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f976ffff700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 0x7f975c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f976807d220 con 0x7f977806df10 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f97777fe700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 0x7f975c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.048+0000 7f97777fe700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 0x7f975c062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97600097c0 tx=0x7f9760018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.056+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f976804d670 con 0x7f977806df10 2024-08-17T02:27:58.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.252+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977806e950 con 0x7f977806df10 2024-08-17T02:27:58.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f976ffff700 1 -- 172.21.15.155:0/2318277620 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f9768050c90 con 0x7f977806df10 2024-08-17T02:27:58.257 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:58.258 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:58.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 msgr2=0x7f975c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 0x7f975c062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97600097c0 tx=0x7f9760018000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 msgr2=0x7f9778141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f976800ec80 tx=0x7f97680091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 shutdown_connections 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f975c060860 0x7f975c062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9778155d20 0x7f9778156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97780ad7c0 0x7f97781560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 --2- 172.21.15.155:0/2318277620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f977806df10 0x7f9778141a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 >> 172.21.15.155:0/2318277620 conn(0x7f97780678d0 msgr2=0x7f9778152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 shutdown_connections 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.256+0000 7f977d62f700 1 -- 172.21.15.155:0/2318277620 wait complete. 2024-08-17T02:27:58.261 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:58.272 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 Processor -- start 2024-08-17T02:27:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 -- start start 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f24c806e510 0x7f24c81556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24c813e250 0x7f24c813e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c8156940 con 0x7f24c806e140 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c813ec10 con 0x7f24c813e250 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c759e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c8155d30 con 0x7f24c806e510 2024-08-17T02:27:58.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c659c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f24c806e140 0x7f24c80b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50704/0 (socket says 172.21.15.155:50704) 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c659c700 1 -- 172.21.15.155:0/1623119822 learned_addr learned my addr 172.21.15.155:0/1623119822 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/1623119822 >> v2:172.21.15.155:3300/0 conn(0x7f24c813e250 0x7f24c813e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c5d9b700 1 --2- 172.21.15.155:0/1623119822 >> v2:172.21.15.189:3300/0 conn(0x7f24c806e510 0x7f24c81556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c559a700 1 -- 172.21.15.155:0/1623119822 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111616648 0 0) 0x7f24c8156940 con 0x7f24c806e140 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c559a700 1 -- 172.21.15.155:0/1623119822 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003570 con 0x7f24c806e140 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c6d9d700 1 -- 172.21.15.155:0/1623119822 >> v2:172.21.15.189:3300/0 conn(0x7f24c806e510 msgr2=0x7f24c81556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/1623119822 >> v2:172.21.15.189:3300/0 conn(0x7f24c806e510 0x7f24c81556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c6d9d700 1 -- 172.21.15.155:0/1623119822 >> v1:172.21.15.155:6789/0 conn(0x7f24c806e140 legacy=0x7f24c80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.372+0000 7f24c6d9d700 1 -- 172.21.15.155:0/1623119822 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8156010 con 0x7f24c813e250 2024-08-17T02:27:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/1623119822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c813e6d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f24c806c630 tx=0x7f24b8008210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5d790325f289cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c559a700 1 -- 172.21.15.155:0/1623119822 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8010070 con 0x7f24c813e250 2024-08-17T02:27:58.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c559a700 1 -- 172.21.15.155:0/1623119822 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800da20 con 0x7f24c813e250 2024-08-17T02:27:58.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c559a700 1 -- 172.21.15.155:0/1623119822 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800ddc0 con 0x7f24c813e250 2024-08-17T02:27:58.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- 172.21.15.155:0/1623119822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 msgr2=0x7f24c813e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 --2- 172.21.15.155:0/1623119822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c813e6d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f24c806c630 tx=0x7f24b8008210 comp rx=0 tx=0).stop 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- 172.21.15.155:0/1623119822 shutdown_connections 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 --2- 172.21.15.155:0/1623119822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c813e6d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 --2- 172.21.15.155:0/1623119822 >> v2:172.21.15.189:3300/0 conn(0x7f24c806e510 0x7f24c81556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- 172.21.15.155:0/1623119822 >> 172.21.15.155:0/1623119822 conn(0x7f24c80678d0 msgr2=0x7f24c8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- 172.21.15.155:0/1623119822 shutdown_connections 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- 172.21.15.155:0/1623119822 wait complete. 2024-08-17T02:27:58.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 Processor -- start 2024-08-17T02:27:58.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.376+0000 7f24c759e700 1 -- start start 2024-08-17T02:27:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24c806e140 0x7f24c8133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 0x7f24c8139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8132100 con 0x7f24c813e250 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8154a80 con 0x7f24c806e510 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8134130 con 0x7f24c806e140 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53698/0 (socket says 172.21.15.155:53698) 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 -- 172.21.15.155:0/3237120642 learned_addr learned my addr 172.21.15.155:0/3237120642 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c659c700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24c806e140 0x7f24c8133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c5d9b700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 0x7f24c8139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 -- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24c806e140 msgr2=0x7f24c8133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24c806e140 0x7f24c8133150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 -- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 msgr2=0x7f24c8139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 0x7f24c8139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 -- 172.21.15.155:0/3237120642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80084b0 con 0x7f24c813e250 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c5d9b700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 0x7f24c8139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c6d9d700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24b8008480 tx=0x7f24b801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b801f710 con 0x7f24c813e250 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b801f870 con 0x7f24c813e250 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c8138a10 con 0x7f24c813e250 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b801fc30 con 0x7f24c813e250 2024-08-17T02:27:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c8133ae0 con 0x7f24c813e250 2024-08-17T02:27:58.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c80643a0 con 0x7f24c813e250 2024-08-17T02:27:58.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.380+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f24b8015420 con 0x7f24c813e250 2024-08-17T02:27:58.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.384+0000 7f24b67fc700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 0x7f24a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.384+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f24b8080940 con 0x7f24c813e250 2024-08-17T02:27:58.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.384+0000 7f24c659c700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 0x7f24a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.384+0000 7f24c659c700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 0x7f24a8062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005c50 tx=0x7f24c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.392+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f24b8050e10 con 0x7f24c813e250 2024-08-17T02:27:58.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.588+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24c806f5f0 con 0x7f24c813e250 2024-08-17T02:27:58.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24b67fc700 1 -- 172.21.15.155:0/3237120642 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f24b802d020 con 0x7f24c813e250 2024-08-17T02:27:58.595 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:58.595 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1839343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1839343245},{"type":"v1","addr":"172.21.15.189:6835","nonce":1839343245}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1055547140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1055547140},{"type":"v1","addr":"172.21.15.155:6835","nonce":1055547140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/603758568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":603758568},{"type":"v1","addr":"172.21.15.155:6837","nonce":603758568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:22.024829+0000","modified":"2024-08-17T02:27:24.708183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6833/3348762194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3348762194},{"type":"v1","addr":"172.21.15.189:6833","nonce":3348762194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 msgr2=0x7f24a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 0x7f24a8062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005c50 tx=0x7f24c0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 msgr2=0x7f24c8135ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24b8008480 tx=0x7f24b801c000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 shutdown_connections 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.592+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f24a8060860 0x7f24a8062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24c813e250 0x7f24c8135ac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24c806e510 0x7f24c8139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 --2- 172.21.15.155:0/3237120642 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24c806e140 0x7f24c8133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 >> 172.21.15.155:0/3237120642 conn(0x7f24c80678d0 msgr2=0x7f24c8158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 shutdown_connections 2024-08-17T02:27:58.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.596+0000 7f24c759e700 1 -- 172.21.15.155:0/3237120642 wait complete. 2024-08-17T02:27:58.599 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-08-17T02:27:58.609 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.712+0000 7fda4dcd4700 1 Processor -- start 2024-08-17T02:27:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.712+0000 7fda4dcd4700 1 -- start start 2024-08-17T02:27:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.712+0000 7fda4dcd4700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fda48156220 0x7fda48160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480afc10 con 0x7fda480aa5f0 2024-08-17T02:27:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480b10b0 con 0x7fda48155e50 2024-08-17T02:27:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480aed20 con 0x7fda48156220 2024-08-17T02:27:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda3effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fda480aa5f0 0x7fda4806ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50716/0 (socket says 172.21.15.155:50716) 2024-08-17T02:27:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda3effd700 1 -- 172.21.15.155:0/3967914871 learned_addr learned my addr 172.21.15.155:0/3967914871 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:27:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> v2:172.21.15.189:3300/0 conn(0x7fda48156220 0x7fda48160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120565548 0 0) 0x7fda480afc10 con 0x7fda480aa5f0 2024-08-17T02:27:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda34003570 con 0x7fda480aa5f0 2024-08-17T02:27:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843821216 0 0) 0x7fda34003570 con 0x7fda480aa5f0 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 >> v2:172.21.15.189:3300/0 conn(0x7fda48156220 msgr2=0x7fda48160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 --2- 172.21.15.155:0/3967914871 >> v2:172.21.15.189:3300/0 conn(0x7fda48156220 0x7fda48160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 >> v1:172.21.15.189:6789/0 conn(0x7fda48155e50 legacy=0x7fda480a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480af000 con 0x7fda480aa5f0 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fda30001470 con 0x7fda480aa5f0 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 >> v1:172.21.15.155:6789/0 conn(0x7fda480aa5f0 legacy=0x7fda4806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda34003a60 0x7fda34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda34004810 0x7fda34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480aed20 con 0x7fda340051c0 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3400c160 con 0x7fda34004810 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3400e530 con 0x7fda34003a60 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> v2:172.21.15.189:3300/0 conn(0x7fda48156220 0x7fda48160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda477fe700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda34003a60 0x7fda34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda3effd700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda34004810 0x7fda34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 -- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda34003a60 msgr2=0x7fda34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda34003a60 0x7fda34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 -- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda34004810 msgr2=0x7fda34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda34004810 0x7fda34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 -- 172.21.15.155:0/3967914871 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34003570 con 0x7fda340051c0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 -- 172.21.15.155:0/3967914871 reap_dead start 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda47fff700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda3400ba60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e3c0 tx=0x7fda4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf387a65cd0bf29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40009c50 con 0x7fda340051c0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000f040 con 0x7fda340051c0 2024-08-17T02:27:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda46ffd700 1 -- 172.21.15.155:0/3967914871 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000eea0 con 0x7fda340051c0 2024-08-17T02:27:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 msgr2=0x7fda3400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda3400ba60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda4000e3c0 tx=0x7fda4000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- 172.21.15.155:0/3967914871 shutdown_connections 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/3967914871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda3400ba60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- 172.21.15.155:0/3967914871 >> 172.21.15.155:0/3967914871 conn(0x7fda48066e00 msgr2=0x7fda48067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- 172.21.15.155:0/3967914871 shutdown_connections 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.716+0000 7fda4dcd4700 1 -- 172.21.15.155:0/3967914871 wait complete. 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 Processor -- start 2024-08-17T02:27:58.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 -- start start 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 0x7fda480c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda480c86b0 0x7fda48141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48097b80 con 0x7fda340051c0 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480cb250 con 0x7fda480c86b0 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda4dcd4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda48097e40 con 0x7fda48150950 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53716/0 (socket says 172.21.15.155:53716) 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 -- 172.21.15.155:0/2743630994 learned_addr learned my addr 172.21.15.155:0/2743630994 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda47fff700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda480c86b0 0x7fda48141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda3effd700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 0x7fda480c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 -- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 msgr2=0x7fda480c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 0x7fda480c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 -- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda480c86b0 msgr2=0x7fda48141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda480c86b0 0x7fda48141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 -- 172.21.15.155:0/2743630994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48098120 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda3effd700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 0x7fda480c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda477fe700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda38002950 tx=0x7fda38007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38002e90 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.720+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3800f8d0 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480caef0 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800fc70 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda48141770 con 0x7fda340051c0 2024-08-17T02:27:58.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda481419c0 con 0x7fda340051c0 2024-08-17T02:27:58.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fda380133f0 con 0x7fda340051c0 2024-08-17T02:27:58.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda3ffff700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 0x7fda28062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda3effd700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 0x7fda28062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.724+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda3807c990 con 0x7fda340051c0 2024-08-17T02:27:58.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.728+0000 7fda3effd700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 0x7fda28062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda300015a0 tx=0x7fda30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.732+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fda3804cde0 con 0x7fda340051c0 2024-08-17T02:27:58.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.896+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda480645c0 con 0x7fda340051c0 2024-08-17T02:27:58.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.896+0000 7fda3ffff700 1 -- 172.21.15.155:0/2743630994 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fda38050400 con 0x7fda340051c0 2024-08-17T02:27:58.900 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:27:58.900 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":21,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:27:23.678880+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:20.371090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:21.020182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 msgr2=0x7fda28062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 0x7fda28062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda300015a0 tx=0x7fda30009040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 msgr2=0x7fda480ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda38002950 tx=0x7fda38007d30 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 shutdown_connections 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fda28060860 0x7fda28062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda480c86b0 0x7fda48141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fda48150950 0x7fda480c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 --2- 172.21.15.155:0/2743630994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda340051c0 0x7fda480ca9b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 >> 172.21.15.155:0/2743630994 conn(0x7fda48066e00 msgr2=0x7fda48154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 shutdown_connections 2024-08-17T02:27:58.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:58.900+0000 7fda4dcd4700 1 -- 172.21.15.155:0/2743630994 wait complete. 2024-08-17T02:27:58.915 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:27:59.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 Processor -- start 2024-08-17T02:27:59.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 -- start start 2024-08-17T02:27:59.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffaa41401a0 0x7ffaa415b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa406bb30 con 0x7ffaa406d2c0 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa406bfc0 con 0x7ffaa41408e0 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaaa402700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40b2f10 con 0x7ffaa41401a0 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffaa41401a0 0x7ffaa415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffaa41401a0 0x7ffaa415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53730/0 (socket says 172.21.15.155:53730) 2024-08-17T02:27:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 -- 172.21.15.155:0/3616979827 learned_addr learned my addr 172.21.15.155:0/3616979827 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 -- 172.21.15.155:0/3616979827 >> v1:172.21.15.189:6789/0 conn(0x7ffaa41408e0 legacy=0x7ffaa406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 -- 172.21.15.155:0/3616979827 >> v1:172.21.15.155:6789/0 conn(0x7ffaa406d2c0 legacy=0x7ffaa40b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 -- 172.21.15.155:0/3616979827 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa406af20 con 0x7ffaa41401a0 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa9400700 1 --2- 172.21.15.155:0/3616979827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa41401a0 0x7ffaa415b420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009f20 tx=0x7ffa8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e578a75712876d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa3fff700 1 -- 172.21.15.155:0/3616979827 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00e070 con 0x7ffaa41401a0 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa3fff700 1 -- 172.21.15.155:0/3616979827 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c00ba80 con 0x7ffaa41401a0 2024-08-17T02:27:59.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.020+0000 7ffaa3fff700 1 -- 172.21.15.155:0/3616979827 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0092e0 con 0x7ffaa41401a0 2024-08-17T02:27:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- 172.21.15.155:0/3616979827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa41401a0 msgr2=0x7ffaa415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3616979827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa41401a0 0x7ffaa415b420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009f20 tx=0x7ffa8c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- 172.21.15.155:0/3616979827 shutdown_connections 2024-08-17T02:27:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3616979827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa41401a0 0x7ffaa415b420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- 172.21.15.155:0/3616979827 >> 172.21.15.155:0/3616979827 conn(0x7ffaa40ad930 msgr2=0x7ffaa40afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- 172.21.15.155:0/3616979827 shutdown_connections 2024-08-17T02:27:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- 172.21.15.155:0/3616979827 wait complete. 2024-08-17T02:27:59.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 Processor -- start 2024-08-17T02:27:59.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- start start 2024-08-17T02:27:59.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 0x7ffaa4139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa41408e0 0x7ffaa413a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.024+0000 7ffaaa402700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4167fb0 con 0x7ffaa406d2c0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaaa402700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41676e0 con 0x7ffaa41408e0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaaa402700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa413c9e0 con 0x7ffaa41401a0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53734/0 (socket says 172.21.15.155:53734) 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 -- 172.21.15.155:0/3239324402 learned_addr learned my addr 172.21.15.155:0/3239324402 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa8bff700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 0x7ffaa4139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9c01700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa41408e0 0x7ffaa413a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 -- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 msgr2=0x7ffaa4139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 0x7ffaa4139800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 -- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa41408e0 msgr2=0x7ffaa413a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa41408e0 0x7ffaa413a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 -- 172.21.15.155:0/3239324402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c009ae0 con 0x7ffaa406d2c0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa8bff700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 0x7ffaa4139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa9400700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffaa406ef10 tx=0x7ffa8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c008bb0 con 0x7ffaa406d2c0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c008d10 con 0x7ffaa406d2c0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0266b0 con 0x7ffaa406d2c0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa4167960 con 0x7ffaa406d2c0 2024-08-17T02:27:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa4139d40 con 0x7ffaa406d2c0 2024-08-17T02:27:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa4064330 con 0x7ffaa406d2c0 2024-08-17T02:27:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa8c003040 con 0x7ffaa406d2c0 2024-08-17T02:27:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 0x7ffa84062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa8c07eae0 con 0x7ffaa406d2c0 2024-08-17T02:27:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.028+0000 7ffaa8bff700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 0x7ffa84062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.032+0000 7ffaa8bff700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 0x7ffa84062d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffaa413c1f0 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.036+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa8c04ef30 con 0x7ffaa406d2c0 2024-08-17T02:27:59.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.236+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffaa40b3a70 con 0x7ffaa406d2c0 2024-08-17T02:27:59.241 INFO:tasks.ceph.mon.a.smithi155.stderr:2024-08-17T02:27:59.240+0000 7fac07105700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:27:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaa17fa700 1 -- 172.21.15.155:0/3239324402 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffa8c052550 con 0x7ffaa406d2c0 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 msgr2=0x7ffa84062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 0x7ffa84062d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffaa413c1f0 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 msgr2=0x7ffaa413c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffaa406ef10 tx=0x7ffa8c018000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 shutdown_connections 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ffa84060890 0x7ffa84062d40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffaa41408e0 0x7ffaa413a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffaa41401a0 0x7ffaa4139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 --2- 172.21.15.155:0/3239324402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffaa406d2c0 0x7ffaa413c400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 >> 172.21.15.155:0/3239324402 conn(0x7ffaa40ad930 msgr2=0x7ffaa40cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 shutdown_connections 2024-08-17T02:27:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.248+0000 7ffaaa402700 1 -- 172.21.15.155:0/3239324402 wait complete. 2024-08-17T02:27:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:27:59.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:27:59.284 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-08-17T02:27:59.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 Processor -- start 2024-08-17T02:27:59.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 -- start start 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fceb0159300 0x7fceb00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fceb0067510 0x7fceb00cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb00cba90 con 0x7fceb01596d0 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00b2b60 con 0x7fceb0067510 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceb59c9700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00cb160 con 0x7fceb0159300 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fceb0067510 0x7fceb00cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fceb0067510 0x7fceb00cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53750/0 (socket says 172.21.15.155:53750) 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 -- 172.21.15.155:0/315198146 learned_addr learned my addr 172.21.15.155:0/315198146 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaeffd700 1 --2- 172.21.15.155:0/315198146 >> v2:172.21.15.189:3300/0 conn(0x7fceb0159300 0x7fceb00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 -- 172.21.15.155:0/315198146 >> v2:172.21.15.189:3300/0 conn(0x7fceb0159300 msgr2=0x7fceb00b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 --2- 172.21.15.155:0/315198146 >> v2:172.21.15.189:3300/0 conn(0x7fceb0159300 0x7fceb00b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 -- 172.21.15.155:0/315198146 >> v1:172.21.15.189:6789/0 conn(0x7fceb01596d0 legacy=0x7fceb0066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 -- 172.21.15.155:0/315198146 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00cb440 con 0x7fceb0067510 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceaf7fe700 1 --2- 172.21.15.155:0/315198146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0067510 0x7fceb00cbf20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fceb0089460 tx=0x7fcea8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a86833f00426ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceadffb700 1 -- 172.21.15.155:0/315198146 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800e070 con 0x7fceb0067510 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceadffb700 1 -- 172.21.15.155:0/315198146 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800ba50 con 0x7fceb0067510 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.376+0000 7fceadffb700 1 -- 172.21.15.155:0/315198146 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80092e0 con 0x7fceb0067510 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- 172.21.15.155:0/315198146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0067510 msgr2=0x7fceb00cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 --2- 172.21.15.155:0/315198146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0067510 0x7fceb00cbf20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fceb0089460 tx=0x7fcea8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- 172.21.15.155:0/315198146 shutdown_connections 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 --2- 172.21.15.155:0/315198146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0067510 0x7fceb00cbf20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 --2- 172.21.15.155:0/315198146 >> v2:172.21.15.189:3300/0 conn(0x7fceb0159300 0x7fceb00b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- 172.21.15.155:0/315198146 >> 172.21.15.155:0/315198146 conn(0x7fceb00682c0 msgr2=0x7fceb00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- 172.21.15.155:0/315198146 shutdown_connections 2024-08-17T02:27:59.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- 172.21.15.155:0/315198146 wait complete. 2024-08-17T02:27:59.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 Processor -- start 2024-08-17T02:27:59.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.380+0000 7fceb59c9700 1 -- start start 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb0067510 0x7fceb00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb01596d0 0x7fceb00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb015d340 con 0x7fceb0159300 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb015d620 con 0x7fceb01596d0 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb015d900 con 0x7fceb0067510 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53756/0 (socket says 172.21.15.155:53756) 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 -- 172.21.15.155:0/2330304548 learned_addr learned my addr 172.21.15.155:0/2330304548 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceaeffd700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb0067510 0x7fceb00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceaf7fe700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb01596d0 0x7fceb00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 -- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb0067510 msgr2=0x7fceb00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb0067510 0x7fceb00c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 -- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb01596d0 msgr2=0x7fceb00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb01596d0 0x7fceb00b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 -- 172.21.15.155:0/2330304548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8009ae0 con 0x7fceb0159300 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceae7fc700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4e0 tx=0x7fcea000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011590 con 0x7fceb0159300 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0011710 con 0x7fceb0159300 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011ad0 con 0x7fceb0159300 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb015dbe0 con 0x7fceb0159300 2024-08-17T02:27:59.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb015cf80 con 0x7fceb0159300 2024-08-17T02:27:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.384+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb00645c0 con 0x7fceb0159300 2024-08-17T02:27:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.388+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcea001b3b0 con 0x7fceb0159300 2024-08-17T02:27:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.388+0000 7fce96ffd700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 0x7fce9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.388+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fcea007bfb0 con 0x7fceb0159300 2024-08-17T02:27:59.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.388+0000 7fceaeffd700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 0x7fce9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.388+0000 7fceaeffd700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 0x7fce9c062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcea4006fd0 tx=0x7fcea4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.396+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcea004c3b0 con 0x7fceb0159300 2024-08-17T02:27:59.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:27:59.596+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fceb00cda80 con 0x7fceb0159300 2024-08-17T02:28:00.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.256+0000 7fce96ffd700 1 -- 172.21.15.155:0/2330304548 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcea00170a0 con 0x7fceb0159300 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 msgr2=0x7fce9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 0x7fce9c062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcea4006fd0 tx=0x7fcea4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 msgr2=0x7fceb0154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4e0 tx=0x7fcea000c7f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 shutdown_connections 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce9c060860 0x7fce9c062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fceb01596d0 0x7fceb00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceb0159300 0x7fceb0154f30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 --2- 172.21.15.155:0/2330304548 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fceb0067510 0x7fceb00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 >> 172.21.15.155:0/2330304548 conn(0x7fceb00682c0 msgr2=0x7fceb0066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 shutdown_connections 2024-08-17T02:28:00.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.260+0000 7fceb59c9700 1 -- 172.21.15.155:0/2330304548 wait complete. 2024-08-17T02:28:00.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:00.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 Processor -- start 2024-08-17T02:28:00.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 -- start start 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9194068be0 0x7f919415b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9194069040 con 0x7f9194158fe0 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9194159f20 con 0x7f9194068be0 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f919359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919415a200 con 0x7f91940abae0 2024-08-17T02:28:00.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.384+0000 7f9191d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:50712/0 (socket says 172.21.15.155:50712) 2024-08-17T02:28:00.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9192d9d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9194068be0 0x7f919415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 -- 172.21.15.155:0/3384056619 learned_addr learned my addr 172.21.15.155:0/3384056619 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 -- 172.21.15.155:0/3384056619 >> v2:172.21.15.189:3300/0 conn(0x7f9194068be0 msgr2=0x7f919415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 --2- 172.21.15.155:0/3384056619 >> v2:172.21.15.189:3300/0 conn(0x7f9194068be0 0x7f919415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 -- 172.21.15.155:0/3384056619 >> v1:172.21.15.189:6789/0 conn(0x7f9194158fe0 legacy=0x7f91941593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 -- 172.21.15.155:0/3384056619 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919415a4e0 con 0x7f91940abae0 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f9191d9b700 1 --2- 172.21.15.155:0/3384056619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91840099b0 tx=0x7f9184009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5b8c7c375b10a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919159a700 1 -- 172.21.15.155:0/3384056619 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184009ea0 con 0x7f91940abae0 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919159a700 1 -- 172.21.15.155:0/3384056619 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918400b860 con 0x7f91940abae0 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919159a700 1 -- 172.21.15.155:0/3384056619 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918400bc00 con 0x7f91940abae0 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 -- 172.21.15.155:0/3384056619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 msgr2=0x7f91940686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 --2- 172.21.15.155:0/3384056619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91840099b0 tx=0x7f9184009250 comp rx=0 tx=0).stop 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 -- 172.21.15.155:0/3384056619 shutdown_connections 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 --2- 172.21.15.155:0/3384056619 >> v2:172.21.15.189:3300/0 conn(0x7f9194068be0 0x7f919415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 --2- 172.21.15.155:0/3384056619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940686a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 -- 172.21.15.155:0/3384056619 >> 172.21.15.155:0/3384056619 conn(0x7f91940ccfe0 msgr2=0x7f919406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 -- 172.21.15.155:0/3384056619 shutdown_connections 2024-08-17T02:28:00.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.388+0000 7f919359e700 1 -- 172.21.15.155:0/3384056619 wait complete. 2024-08-17T02:28:00.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 Processor -- start 2024-08-17T02:28:00.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- start start 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9194068be0 0x7f91940cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9194158fe0 0x7f9194143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194143af0 con 0x7f9194158fe0 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940c25d0 con 0x7f9194068be0 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91940cb380 con 0x7f91940abae0 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9192d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9194158fe0 0x7f9194143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:50726/0 (socket says 172.21.15.155:50726) 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 -- 172.21.15.155:0/1366857337 learned_addr learned my addr 172.21.15.155:0/1366857337 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919259c700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9194068be0 0x7f91940cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 -- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9194068be0 msgr2=0x7f91940cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9194068be0 0x7f91940cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 -- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9194158fe0 msgr2=0x7f9194143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9194158fe0 0x7f9194143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 -- 172.21.15.155:0/1366857337 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840094f0 con 0x7f91940abae0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f9191d9b700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918400bbe0 con 0x7f91940abae0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9184000c90 con 0x7f91940abae0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91940c19c0 con 0x7f91940abae0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184011650 con 0x7f91940abae0 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.392+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91940c1f80 con 0x7f91940abae0 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91940644b0 con 0x7f91940abae0 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9184011a40 con 0x7f91940abae0 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f918a7fc700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 0x7f9174062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f919259c700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 0x7f9174062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f918407e4b0 con 0x7f91940abae0 2024-08-17T02:28:00.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.396+0000 7f919259c700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 0x7f9174062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f917c0039e0 tx=0x7f917c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.408+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f918404e810 con 0x7f91940abae0 2024-08-17T02:28:00.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:00.572+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91940c2710 con 0x7f91940abae0 2024-08-17T02:28:01.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.268+0000 7f918a7fc700 1 -- 172.21.15.155:0/1366857337 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9184051e30 con 0x7f91940abae0 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 msgr2=0x7f9174062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 0x7f9174062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f917c0039e0 tx=0x7f917c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 msgr2=0x7f91940c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184017000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 shutdown_connections 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9174060860 0x7f9174062d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9194158fe0 0x7f9194143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91940abae0 0x7f91940c2a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 --2- 172.21.15.155:0/1366857337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9194068be0 0x7f91940cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 >> 172.21.15.155:0/1366857337 conn(0x7f91940ccfe0 msgr2=0x7f91941595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 shutdown_connections 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.272+0000 7f919359e700 1 -- 172.21.15.155:0/1366857337 wait complete. 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:01.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:01.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 Processor -- start 2024-08-17T02:28:01.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 -- start start 2024-08-17T02:28:01.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 0x7f42900abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 0x7f4290159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4290159f20 con 0x7f42900686a0 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4290159d40 con 0x7f42901593b0 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.396+0000 7f429599c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429015a200 con 0x7f4290158fe0 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429519b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f42900686a0 0x7f429015cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50732/0 (socket says 172.21.15.155:50732) 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429519b700 1 -- 172.21.15.155:0/3154596999 learned_addr learned my addr 172.21.15.155:0/3154596999 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 --2- 172.21.15.155:0/3154596999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 0x7f42900abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428ffff700 1 --2- 172.21.15.155:0/3154596999 >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 0x7f4290159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428f7fe700 1 -- 172.21.15.155:0/3154596999 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392400405 0 0) 0x7f4290159f20 con 0x7f42900686a0 2024-08-17T02:28:01.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428f7fe700 1 -- 172.21.15.155:0/3154596999 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f427c003570 con 0x7f42900686a0 2024-08-17T02:28:01.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 -- 172.21.15.155:0/3154596999 >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 msgr2=0x7f4290159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 --2- 172.21.15.155:0/3154596999 >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 0x7f4290159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 -- 172.21.15.155:0/3154596999 >> v1:172.21.15.155:6789/0 conn(0x7f42900686a0 legacy=0x7f429015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 -- 172.21.15.155:0/3154596999 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429015a4e0 con 0x7f4290158fe0 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428ffff700 1 --2- 172.21.15.155:0/3154596999 >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 0x7f4290159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429499a700 1 --2- 172.21.15.155:0/3154596999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 0x7f42900abae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42800098e0 tx=0x7f42800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5701e8de20b84a04 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428f7fe700 1 -- 172.21.15.155:0/3154596999 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011630 con 0x7f4290158fe0 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428f7fe700 1 -- 172.21.15.155:0/3154596999 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280011790 con 0x7f4290158fe0 2024-08-17T02:28:01.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f428f7fe700 1 -- 172.21.15.155:0/3154596999 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011b30 con 0x7f4290158fe0 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 -- 172.21.15.155:0/3154596999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 msgr2=0x7f42900abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 --2- 172.21.15.155:0/3154596999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 0x7f42900abae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42800098e0 tx=0x7f42800091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 -- 172.21.15.155:0/3154596999 shutdown_connections 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 --2- 172.21.15.155:0/3154596999 >> v2:172.21.15.189:3300/0 conn(0x7f42901593b0 0x7f4290159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 --2- 172.21.15.155:0/3154596999 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290158fe0 0x7f42900abae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 -- 172.21.15.155:0/3154596999 >> 172.21.15.155:0/3154596999 conn(0x7f42900ccfe0 msgr2=0x7f429006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 -- 172.21.15.155:0/3154596999 shutdown_connections 2024-08-17T02:28:01.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.400+0000 7f429599c700 1 -- 172.21.15.155:0/3154596999 wait complete. 2024-08-17T02:28:01.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.404+0000 7f429599c700 1 Processor -- start 2024-08-17T02:28:01.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.404+0000 7f429599c700 1 -- start start 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900686a0 0x7f429014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 0x7f42900c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429015ccb0 con 0x7f42901593b0 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429015d230 con 0x7f4290158fe0 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900c2920 con 0x7f42900686a0 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53774/0 (socket says 172.21.15.155:53774) 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 -- 172.21.15.155:0/3345916845 learned_addr learned my addr 172.21.15.155:0/3345916845 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429499a700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900686a0 0x7f429014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428ffff700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 0x7f42900c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 -- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900686a0 msgr2=0x7f429014a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900686a0 0x7f429014a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 -- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 msgr2=0x7f42900c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 0x7f42900c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 -- 172.21.15.155:0/3345916845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009420 con 0x7f42901593b0 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428ffff700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 0x7f42900c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429519b700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4288001460 tx=0x7f4288001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800a940 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800aaa0 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280009420 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800ae20 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429015cec0 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42900644b0 con 0x7f42901593b0 2024-08-17T02:28:01.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.408+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4288007300 con 0x7f42901593b0 2024-08-17T02:28:01.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.412+0000 7f428cff9700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 0x7f4270062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.412+0000 7f429499a700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 0x7f4270062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.412+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f428807ceb0 con 0x7f42901593b0 2024-08-17T02:28:01.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.412+0000 7f429499a700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 0x7f4270062d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42800091e0 tx=0x7f4280017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.420+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f428804d450 con 0x7f42901593b0 2024-08-17T02:28:01.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:01.588+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42900b0b50 con 0x7f42901593b0 2024-08-17T02:28:02.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.268+0000 7f428cff9700 1 -- 172.21.15.155:0/3345916845 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4288050a70 con 0x7f42901593b0 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 msgr2=0x7f4270062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 0x7f4270062d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42800091e0 tx=0x7f4280017000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 msgr2=0x7f42900c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4288001460 tx=0x7f4288001ae0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 shutdown_connections 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4270060890 0x7f4270062d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42901593b0 0x7f42900c3540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158fe0 0x7f42900c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 --2- 172.21.15.155:0/3345916845 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900686a0 0x7f429014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 >> 172.21.15.155:0/3345916845 conn(0x7f42900ccfe0 msgr2=0x7f42900aba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 shutdown_connections 2024-08-17T02:28:02.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.276+0000 7f429599c700 1 -- 172.21.15.155:0/3345916845 wait complete. 2024-08-17T02:28:02.282 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:02.294 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:28:02.294 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:28:02.294 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:02.295 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:02.295 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:28:02.295 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:28:02.295 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:02.295 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:02.295 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:28:02.295 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:28:02.296 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:02.296 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:02.296 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:28:02.296 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:28:02.296 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:02.296 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:02.306 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:02.307 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:28:02.307 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:02.307 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:28:02.308 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:02.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:28:02.310 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:02.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:28:02.349 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:28:02.349 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:02.349 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:28:02.350 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:02.354 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:28:02.355 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:02.356 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:28:02.356 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:02.356 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:28:02.425 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-08-17T02:28:02.426 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-08-17T02:28:02.432 INFO:tasks.ceph.mds.c.smithi155.stdout:starting mds.c at 2024-08-17T02:28:02.436 INFO:tasks.ceph.mds.a.smithi155.stdout:starting mds.a at 2024-08-17T02:28:02.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 Processor -- start 2024-08-17T02:28:02.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 -- start start 2024-08-17T02:28:02.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47900aab50 0x7f47901500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900ab020 con 0x7f47900ad4a0 2024-08-17T02:28:02.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900ac0b0 con 0x7f47900ad0d0 2024-08-17T02:28:02.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4797877700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900acc50 con 0x7f47900aab50 2024-08-17T02:28:02.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4795e14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47900aab50 0x7f47901500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4794e12700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f47900ad4a0 0x7f47900aa440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50748/0 (socket says 172.21.15.155:50748) 2024-08-17T02:28:02.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.472+0000 7f4794e12700 1 -- 172.21.15.155:0/3268868173 learned_addr learned my addr 172.21.15.155:0/3268868173 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4787fff700 1 -- 172.21.15.155:0/3268868173 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038911635 0 0) 0x7f47900ac0b0 con 0x7f47900ad0d0 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4795e14700 1 -- 172.21.15.155:0/3268868173 >> v1:172.21.15.189:6789/0 conn(0x7f47900ad0d0 legacy=0x7f47900ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4795e14700 1 -- 172.21.15.155:0/3268868173 >> v1:172.21.15.155:6789/0 conn(0x7f47900ad4a0 legacy=0x7f47900aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4795e14700 1 -- 172.21.15.155:0/3268868173 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900ab780 con 0x7f47900aab50 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4795e14700 1 --2- 172.21.15.155:0/3268868173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900aab50 0x7f47901500f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098e0 tx=0x7f478c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eb564eb7337527 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4787fff700 1 -- 172.21.15.155:0/3268868173 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c009e80 con 0x7f47900aab50 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4787fff700 1 -- 172.21.15.155:0/3268868173 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00b760 con 0x7f47900aab50 2024-08-17T02:28:02.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4787fff700 1 -- 172.21.15.155:0/3268868173 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00bae0 con 0x7f47900aab50 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- 172.21.15.155:0/3268868173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900aab50 msgr2=0x7f47901500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 --2- 172.21.15.155:0/3268868173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900aab50 0x7f47901500f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098e0 tx=0x7f478c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- 172.21.15.155:0/3268868173 shutdown_connections 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 --2- 172.21.15.155:0/3268868173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900aab50 0x7f47901500f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- 172.21.15.155:0/3268868173 >> 172.21.15.155:0/3268868173 conn(0x7f4790068300 msgr2=0x7f47900a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- 172.21.15.155:0/3268868173 shutdown_connections 2024-08-17T02:28:02.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- 172.21.15.155:0/3268868173 wait complete. 2024-08-17T02:28:02.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 Processor -- start 2024-08-17T02:28:02.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.476+0000 7f4797877700 1 -- start start 2024-08-17T02:28:02.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47900ad0d0 0x7f479016d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 0x7f4790154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479016d7a0 con 0x7f47900ad4a0 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790159bc0 con 0x7f47900ad0d0 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47901550d0 con 0x7f47900aab50 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 0x7f4790154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795613700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795613700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:50760/0 (socket says 172.21.15.155:50760) 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795613700 1 -- 172.21.15.155:0/3733775668 learned_addr learned my addr 172.21.15.155:0/3733775668 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:02.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4794e12700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47900ad0d0 0x7f479016d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 -- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 msgr2=0x7f479015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 -- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47900ad0d0 msgr2=0x7f479016d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47900ad0d0 0x7f479016d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 -- 172.21.15.155:0/3733775668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009420 con 0x7f47900ad4a0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795613700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4795e14700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 0x7f4790154b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f478c015000 tx=0x7f478c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c01c480 con 0x7f47900ad4a0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c01c600 con 0x7f47900ad4a0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c01c9c0 con 0x7f47900ad4a0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479015bb00 con 0x7f47900ad4a0 2024-08-17T02:28:02.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.480+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4790159850 con 0x7f47900ad4a0 2024-08-17T02:28:02.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4790159d30 con 0x7f47900ad4a0 2024-08-17T02:28:02.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f478c01cd30 con 0x7f47900ad4a0 2024-08-17T02:28:02.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f47857fa700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 0x7f4774062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f478c07e6d0 con 0x7f47900ad4a0 2024-08-17T02:28:02.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f4795613700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 0x7f4774062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.484+0000 7f4795613700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 0x7f4774062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4788001560 tx=0x7f4788009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.492+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f478c04ee00 con 0x7f47900ad4a0 2024-08-17T02:28:02.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:02.546 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:02.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:02.664+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4790070360 con 0x7f47900ad4a0 2024-08-17T02:28:03.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.284+0000 7f47857fa700 1 -- 172.21.15.155:0/3733775668 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f478c052420 con 0x7f47900ad4a0 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.288+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 msgr2=0x7f4774062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.288+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 0x7f4774062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4788001560 tx=0x7f4788009040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.288+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 msgr2=0x7f4790154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.288+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 0x7f4790154b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f478c015000 tx=0x7f478c016000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 shutdown_connections 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4774060890 0x7f4774062d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47900ad4a0 0x7f4790154b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47900ad0d0 0x7f479016d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 --2- 172.21.15.155:0/3733775668 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47900aab50 0x7f479015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 >> 172.21.15.155:0/3733775668 conn(0x7f4790068300 msgr2=0x7f47900ac540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 shutdown_connections 2024-08-17T02:28:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.292+0000 7f4797877700 1 -- 172.21.15.155:0/3733775668 wait complete. 2024-08-17T02:28:03.295 INFO:teuthology.orchestra.run.smithi155.stderr: removed all blocklist entries 2024-08-17T02:28:03.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:28:03.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 Processor -- start 2024-08-17T02:28:03.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 -- start start 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 0x7fa7641556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa76413e250 0x7fa76413e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa764156940 con 0x7fa76406e140 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76413ec10 con 0x7fa76413e250 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa768997700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa764155d30 con 0x7fa76406e510 2024-08-17T02:28:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa7637fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa76406e140 0x7fa7640b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:50752/0 (socket says 172.21.15.155:50752) 2024-08-17T02:28:03.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa7637fe700 1 -- 172.21.15.155:0/3092397715 learned_addr learned my addr 172.21.15.155:0/3092397715 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:03.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3092397715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 0x7fa7641556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa763fff700 1 --2- 172.21.15.155:0/3092397715 >> v2:172.21.15.189:3300/0 conn(0x7fa76413e250 0x7fa76413e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa7627fc700 1 -- 172.21.15.155:0/3092397715 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354157850 0 0) 0x7fa764156940 con 0x7fa76406e140 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa7627fc700 1 -- 172.21.15.155:0/3092397715 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa750003570 con 0x7fa76406e140 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa762ffd700 1 -- 172.21.15.155:0/3092397715 >> v2:172.21.15.189:3300/0 conn(0x7fa76413e250 msgr2=0x7fa76413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3092397715 >> v2:172.21.15.189:3300/0 conn(0x7fa76413e250 0x7fa76413e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa762ffd700 1 -- 172.21.15.155:0/3092397715 >> v1:172.21.15.155:6789/0 conn(0x7fa76406e140 legacy=0x7fa7640b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.420+0000 7fa762ffd700 1 -- 172.21.15.155:0/3092397715 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764156010 con 0x7fa76406e510 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3092397715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 0x7fa7641556f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa754009e60 tx=0x7fa754009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f5e8da253e9d3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa7627fc700 1 -- 172.21.15.155:0/3092397715 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400e070 con 0x7fa76406e510 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa7627fc700 1 -- 172.21.15.155:0/3092397715 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75400bab0 con 0x7fa76406e510 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa7627fc700 1 -- 172.21.15.155:0/3092397715 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400be70 con 0x7fa76406e510 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- 172.21.15.155:0/3092397715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 msgr2=0x7fa7641556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 --2- 172.21.15.155:0/3092397715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 0x7fa7641556f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa754009e60 tx=0x7fa754009780 comp rx=0 tx=0).stop 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- 172.21.15.155:0/3092397715 shutdown_connections 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 --2- 172.21.15.155:0/3092397715 >> v2:172.21.15.189:3300/0 conn(0x7fa76413e250 0x7fa76413e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 --2- 172.21.15.155:0/3092397715 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e510 0x7fa7641556f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- 172.21.15.155:0/3092397715 >> 172.21.15.155:0/3092397715 conn(0x7fa7640678d0 msgr2=0x7fa764067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- 172.21.15.155:0/3092397715 shutdown_connections 2024-08-17T02:28:03.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- 172.21.15.155:0/3092397715 wait complete. 2024-08-17T02:28:03.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 Processor -- start 2024-08-17T02:28:03.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.424+0000 7fa768997700 1 -- start start 2024-08-17T02:28:03.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e140 0x7fa764134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 0x7fa764135c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641347a0 con 0x7fa76406e510 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa764139740 con 0x7fa76413e250 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa764138fb0 con 0x7fa76406e140 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53840/0 (socket says 172.21.15.155:53840) 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 -- 172.21.15.155:0/3454755841 learned_addr learned my addr 172.21.15.155:0/3454755841 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa7637fe700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e140 0x7fa764134260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa763fff700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 0x7fa764135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 -- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e140 msgr2=0x7fa764134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e140 0x7fa764134260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 -- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 msgr2=0x7fa764135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 0x7fa764135c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 -- 172.21.15.155:0/3454755841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009a20 con 0x7fa76406e510 2024-08-17T02:28:03.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa763fff700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 0x7fa764135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa762ffd700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7641568d0 tx=0x7fa754019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754012c10 con 0x7fa76406e510 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754012d90 con 0x7fa76406e510 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa764134990 con 0x7fa76406e510 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7540276c0 con 0x7fa76406e510 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764134f50 con 0x7fa76406e510 2024-08-17T02:28:03.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.428+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7641398f0 con 0x7fa76406e510 2024-08-17T02:28:03.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.432+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa754024070 con 0x7fa76406e510 2024-08-17T02:28:03.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.432+0000 7fa75b7fe700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 0x7fa744062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.432+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa75407ed40 con 0x7fa76406e510 2024-08-17T02:28:03.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.432+0000 7fa7637fe700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 0x7fa744062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.432+0000 7fa7637fe700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 0x7fa744062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007fd0 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.436+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa7641398f0 con 0x7fa76406e510 2024-08-17T02:28:03.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.656+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa7641398f0 con 0x7fa76406e510 2024-08-17T02:28:03.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.656+0000 7fa75b7fe700 1 -- 172.21.15.155:0/3454755841 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa7641398f0 con 0x7fa76406e510 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "auth_dump": [ 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mds.a", 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmdIa/IhAASPYHvChuC7XsDnNrPp+r2w==", 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow *", 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow *", 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mds.b", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmPvIJKhAAoATze8I/tcdNENFt+VviFg==", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow *", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow *", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mds.c", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmiIA3JhAAi5FgxA5HDGiWOOOATU2MKw==", 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.661 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow *", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow *", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mds.d", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBm8ZZgLRAAeQpv0GaqjAXkzX7zurZNPA==", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow *", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow *", 2024-08-17T02:28:03.662 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.0", 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBcCsBmVtNJIhAAyms6eFCQcY6D3YZkkiCxgQ==", 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.663 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.1", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBfCsBm+6Z1JBAARGmc6GTBhd6EbaA9fBLoYQ==", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.2", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBiCsBmwgWQKhAAuz3k9egfmWcppqxptUZNkw==", 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.664 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.3", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBlCsBmXktyLBAAT7mNLvDspCr7Mw3Ug4xwZQ==", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.4", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBrCsBmI4l4EBAAQQZav2OymcSCfSvJHvBvng==", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.5", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBuCsBmE96bFRAANJZCawWmiDApBWr85r8hvA==", 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.6", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBxCsBmsXYGGxAASLcUPp4EGpGVxscdwYW75g==", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "osd.7", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB0CsBmapJZHhAA1Fgyhb98cDfqVZK+9FBobA==", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile osd", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.0", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmEw9sMBAAxsk9nYQ90EppDAjADBv6nQ==", 2024-08-17T02:28:03.668 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow r", 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow rw", 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow rwx" 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.1", 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmvp/+OBAAsCwELZoYXMpwpn80hPWoIw==", 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow r", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow rw", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow rwx" 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.2", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmuc4ANhAA3aniaiFafw2jxPVyxdc2ig==", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow r", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow rw", 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow rwx" 2024-08-17T02:28:03.670 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.3", 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBaCsBmHAbcAhAAcQZ7+KivUsKyKOWsVhP/Rg==", 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow", 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow r", 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow rw", 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow rwx" 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.671 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.admin", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmz3mVEhAAb492zneacuYTW93hy7roTQ==", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow *", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": "allow *", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow *", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmRjJ6KBAAewDni9NPT4GSjMf4OaWEzg==", 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmEEt6KBAAvBC4g95l9cuZd4vDJUuXmA==", 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmE2R6KBAAKvqv3VeAftVG9We1+uKkrw==", 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmxXl6KBAAbNG2TbYKAGuOUaKSPxl9Yg==", 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmJpR6KBAAcRWLLxYFuH8hqjAGAiZK3g==", 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:28:03.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQB5CsBmaqt6KBAAPE4o5rsuZgVeQiAwz2KRXg==", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mgr.x", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBmDquGHxAAg0PWcBKXSwJl4b1keWww2g==", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow *", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.675 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:03.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:03.676 INFO:teuthology.orchestra.run.smithi155.stdout: "entity": "mgr.y", 2024-08-17T02:28:03.676 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "AQBZCsBm5+S7HBAA+3bKtHQsHsizdFmKAdBV+g==", 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": { 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": "allow *", 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": "allow *" 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-08-17T02:28:03.677 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 msgr2=0x7fa744062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 0x7fa744062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007fd0 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 msgr2=0x7fa7641549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7641568d0 tx=0x7fa754019000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 shutdown_connections 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa744060860 0x7fa744062d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76413e250 0x7fa764135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa76406e510 0x7fa7641549a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 --2- 172.21.15.155:0/3454755841 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa76406e140 0x7fa764134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 >> 172.21.15.155:0/3454755841 conn(0x7fa7640678d0 msgr2=0x7fa7641595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 shutdown_connections 2024-08-17T02:28:03.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.660+0000 7fa768997700 1 -- 172.21.15.155:0/3454755841 wait complete. 2024-08-17T02:28:03.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:28:03.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.784+0000 7fbac676d700 1 Processor -- start 2024-08-17T02:28:03.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.784+0000 7fbac676d700 1 -- start start 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbac0154900 0x7fbac00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00b1730 con 0x7fbac00b12d0 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00cbaa0 con 0x7fbac00cb560 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac0068790 con 0x7fbac0154900 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbac00b12d0 0x7fbac00cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35628/0 (socket says 172.21.15.155:35628) 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 -- 172.21.15.155:0/1251919245 learned_addr learned my addr 172.21.15.155:0/1251919245 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:03.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac576b700 1 --2- 172.21.15.155:0/1251919245 >> v2:172.21.15.189:3300/0 conn(0x7fbac0154900 0x7fbac00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183987902 0 0) 0x7fbab4001110 con 0x7fbac00b12d0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa8003570 con 0x7fbac00b12d0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872878173 0 0) 0x7fbaa8003570 con 0x7fbac00b12d0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 >> v2:172.21.15.189:3300/0 conn(0x7fbac0154900 msgr2=0x7fbac00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 --2- 172.21.15.155:0/1251919245 >> v2:172.21.15.189:3300/0 conn(0x7fbac0154900 0x7fbac00b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 >> v1:172.21.15.189:6789/0 conn(0x7fbac00cb560 legacy=0x7fbac0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0157630 con 0x7fbac00b12d0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fbab4001600 con 0x7fbac00b12d0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 >> v1:172.21.15.155:6789/0 conn(0x7fbac00b12d0 legacy=0x7fbac00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaa8003a60 0x7fbaa8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 0x7fbaa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa80051c0 0x7fbaa800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0068790 con 0x7fbaa8004810 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa800c050 con 0x7fbaa80051c0 2024-08-17T02:28:03.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa800c210 con 0x7fbaa8003a60 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 0x7fbaa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac576b700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaa8003a60 0x7fbaa8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac5f6c700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa80051c0 0x7fbaa800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 -- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaa8003a60 msgr2=0x7fbaa8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaa8003a60 0x7fbaa8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 -- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa80051c0 msgr2=0x7fbaa800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa80051c0 0x7fbaa800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 -- 172.21.15.155:0/1251919245 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa8003570 con 0x7fbaa8004810 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac5f6c700 1 -- 172.21.15.155:0/1251919245 reap_dead start 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 0x7fbaa8004c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c5f0 tx=0x7fbab4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef15a7ad3113c662 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400cdf0 con 0x7fbaa8004810 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4005920 con 0x7fbaa8004810 2024-08-17T02:28:03.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbabffff700 1 -- 172.21.15.155:0/1251919245 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4005cc0 con 0x7fbaa8004810 2024-08-17T02:28:03.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 -- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 msgr2=0x7fbaa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.788+0000 7fbac676d700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 0x7fbaa8004c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c5f0 tx=0x7fbab4007a50 comp rx=0 tx=0).stop 2024-08-17T02:28:03.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 -- 172.21.15.155:0/1251919245 shutdown_connections 2024-08-17T02:28:03.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 --2- 172.21.15.155:0/1251919245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa8004810 0x7fbaa8004c80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 -- 172.21.15.155:0/1251919245 >> 172.21.15.155:0/1251919245 conn(0x7fbac00678d0 msgr2=0x7fbac0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 -- 172.21.15.155:0/1251919245 shutdown_connections 2024-08-17T02:28:03.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 -- 172.21.15.155:0/1251919245 wait complete. 2024-08-17T02:28:03.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 Processor -- start 2024-08-17T02:28:03.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.792+0000 7fbac676d700 1 -- start start 2024-08-17T02:28:03.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 0x7fbac0169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbac0150180 0x7fbac0144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00a57a0 con 0x7fbac00aeb40 2024-08-17T02:28:03.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01697d0 con 0x7fbaa8004810 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00af040 con 0x7fbac0150180 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42582/0 (socket says 172.21.15.155:42582) 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 -- 172.21.15.155:0/4180626265 learned_addr learned my addr 172.21.15.155:0/4180626265 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac5f6c700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbac0150180 0x7fbac0144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac576b700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 0x7fbac0169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 -- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbac0150180 msgr2=0x7fbac0144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbac0150180 0x7fbac0144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 -- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 msgr2=0x7fbac0169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 0x7fbac0169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 -- 172.21.15.155:0/4180626265 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00af320 con 0x7fbac00aeb40 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac576b700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 0x7fbac0169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac4f6a700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbab4007d00 tx=0x7fbab4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4001600 con 0x7fbac00aeb40 2024-08-17T02:28:03.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab40072e0 con 0x7fbac00aeb40 2024-08-17T02:28:03.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00af600 con 0x7fbac00aeb40 2024-08-17T02:28:03.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40076a0 con 0x7fbac00aeb40 2024-08-17T02:28:03.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac00afbc0 con 0x7fbac00aeb40 2024-08-17T02:28:03.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.796+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac00643a0 con 0x7fbac00aeb40 2024-08-17T02:28:03.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.800+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbab401e640 con 0x7fbac00aeb40 2024-08-17T02:28:03.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.800+0000 7fbabd7fa700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 0x7fbaac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.800+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbab407d230 con 0x7fbac00aeb40 2024-08-17T02:28:03.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.800+0000 7fbac576b700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 0x7fbaac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.800+0000 7fbac576b700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 0x7fbaac062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbac0061060 tx=0x7fbab8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:03.808+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbab404d9d0 con 0x7fbac00aeb40 2024-08-17T02:28:04.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.028+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbac00b1730 con 0x7fbac00aeb40 2024-08-17T02:28:04.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbabd7fa700 1 -- 172.21.15.155:0/4180626265 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbac00b1730 con 0x7fbac00aeb40 2024-08-17T02:28:04.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 msgr2=0x7fbaac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 0x7fbaac062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbac0061060 tx=0x7fbab8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 msgr2=0x7fbac014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbab4007d00 tx=0x7fbab4015000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 shutdown_connections 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbaac060860 0x7fbaac062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbac0150180 0x7fbac0144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac00aeb40 0x7fbac014fc40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 --2- 172.21.15.155:0/4180626265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa8004810 0x7fbac0169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 >> 172.21.15.155:0/4180626265 conn(0x7fbac00678d0 msgr2=0x7fbac006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 shutdown_connections 2024-08-17T02:28:04.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.036+0000 7fbac676d700 1 -- 172.21.15.155:0/4180626265 wait complete. 2024-08-17T02:28:04.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:28:04.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 Processor -- start 2024-08-17T02:28:04.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 -- start start 2024-08-17T02:28:04.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff8700b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8700cb560 0x7ff870160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8700cbaa0 con 0x7ff8700b12d0 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff870068790 con 0x7ff8700cb560 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.164+0000 7ff8771ad700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8701583f0 con 0x7ff870154900 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8700cb560 0x7ff870160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8700cb560 0x7ff870160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42598/0 (socket says 172.21.15.155:42598) 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 -- 172.21.15.155:0/3169362927 learned_addr learned my addr 172.21.15.155:0/3169362927 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8761ab700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff8700b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 -- 172.21.15.155:0/3169362927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 msgr2=0x7ff8700b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff8700b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 -- 172.21.15.155:0/3169362927 >> v1:172.21.15.189:6789/0 conn(0x7ff8700b12d0 legacy=0x7ff8700cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 -- 172.21.15.155:0/3169362927 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700b1700 con 0x7ff8700cb560 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8769ac700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700cb560 0x7ff870160ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8680099b0 tx=0x7ff868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac1b9159de2df2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8751a9700 1 -- 172.21.15.155:0/3169362927 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86800b860 con 0x7ff8700cb560 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8751a9700 1 -- 172.21.15.155:0/3169362927 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86800b9c0 con 0x7ff8700cb560 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8751a9700 1 -- 172.21.15.155:0/3169362927 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86800bd60 con 0x7ff8700cb560 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 -- 172.21.15.155:0/3169362927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700cb560 msgr2=0x7ff870160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700cb560 0x7ff870160ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8680099b0 tx=0x7ff868009250 comp rx=0 tx=0).stop 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 -- 172.21.15.155:0/3169362927 shutdown_connections 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700cb560 0x7ff870160ac0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 --2- 172.21.15.155:0/3169362927 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff8700b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 -- 172.21.15.155:0/3169362927 >> 172.21.15.155:0/3169362927 conn(0x7ff8700678d0 msgr2=0x7ff870067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 -- 172.21.15.155:0/3169362927 shutdown_connections 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.168+0000 7ff8771ad700 1 -- 172.21.15.155:0/3169362927 wait complete. 2024-08-17T02:28:04.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 Processor -- start 2024-08-17T02:28:04.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 -- start start 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 0x7ff87015b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff87015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015a8d0 con 0x7ff8700b12d0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015abb0 con 0x7ff8700cb560 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8771ad700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015ae90 con 0x7ff870154900 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42612/0 (socket says 172.21.15.155:42612) 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 -- 172.21.15.155:0/2881950142 learned_addr learned my addr 172.21.15.155:0/2881950142 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8769ac700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff87015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8759aa700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 0x7ff87015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 -- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 msgr2=0x7ff87015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff87015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 -- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 msgr2=0x7ff87015b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 0x7ff87015b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 -- 172.21.15.155:0/2881950142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680094f0 con 0x7ff8700b12d0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8759aa700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 0x7ff87015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.172+0000 7ff8761ab700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e190 tx=0x7ff860009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000ed80 con 0x7ff8700b12d0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff860014420 con 0x7ff8700b12d0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87015b170 con 0x7ff8700b12d0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600147e0 con 0x7ff8700b12d0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870159d00 con 0x7ff8700b12d0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8700643a0 con 0x7ff8700b12d0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff860014b90 con 0x7ff8700b12d0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 0x7ff850062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff86007df20 con 0x7ff8700b12d0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff8759aa700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 0x7ff850062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.176+0000 7ff8759aa700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 0x7ff850062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff858007fd0 tx=0x7ff858009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.188+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff86004e6c0 con 0x7ff8700b12d0 2024-08-17T02:28:04.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.412+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff870159f20 con 0x7ff8700b12d0 2024-08-17T02:28:04.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.416+0000 7ff86e7fc700 1 -- 172.21.15.155:0/2881950142 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff860009a60 con 0x7ff8700b12d0 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 msgr2=0x7ff850062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 0x7ff850062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff858007fd0 tx=0x7ff858009040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 msgr2=0x7ff8701597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e190 tx=0x7ff860009920 comp rx=0 tx=0).stop 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 shutdown_connections 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff850060860 0x7ff850062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff870154900 0x7ff87015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8700cb560 0x7ff87015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 --2- 172.21.15.155:0/2881950142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8700b12d0 0x7ff8701597c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 >> 172.21.15.155:0/2881950142 conn(0x7ff8700678d0 msgr2=0x7ff870153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 shutdown_connections 2024-08-17T02:28:04.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.420+0000 7ff8771ad700 1 -- 172.21.15.155:0/2881950142 wait complete. 2024-08-17T02:28:04.435 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:28:04.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.540+0000 7f28ed1a5700 1 Processor -- start 2024-08-17T02:28:04.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.540+0000 7f28ed1a5700 1 -- start start 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28ed1a5700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f28e8153a70 0x7f28e8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28ed1a5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e8157810 con 0x7f28e8153e40 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28ed1a5700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e8157dd0 con 0x7f28e806e9c0 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28ed1a5700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e815a700 con 0x7f28e8153a70 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28de59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f28e8153e40 0x7f28e806e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35630/0 (socket says 172.21.15.155:35630) 2024-08-17T02:28:04.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28de59c700 1 -- 172.21.15.155:0/2427722372 learned_addr learned my addr 172.21.15.155:0/2427722372 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:04.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> v2:172.21.15.189:3300/0 conn(0x7f28e8153a70 0x7f28e8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213861830 0 0) 0x7f28e8157810 con 0x7f28e8153e40 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d4003570 con 0x7f28e8153e40 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854160940 0 0) 0x7f28e8157dd0 con 0x7f28e806e9c0 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e8157810 con 0x7f28e806e9c0 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1223089425 0 0) 0x7f28d4003570 con 0x7f28e8153e40 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 >> v2:172.21.15.189:3300/0 conn(0x7f28e8153a70 msgr2=0x7f28e8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 --2- 172.21.15.155:0/2427722372 >> v2:172.21.15.189:3300/0 conn(0x7f28e8153a70 0x7f28e8159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 >> v1:172.21.15.189:6789/0 conn(0x7f28e806e9c0 legacy=0x7f28e8158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e815a9e0 con 0x7f28e8153e40 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f28d0001470 con 0x7f28e8153e40 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> v2:172.21.15.189:3300/0 conn(0x7f28e8153a70 0x7f28e8159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:04.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 >> v1:172.21.15.155:6789/0 conn(0x7f28e8153e40 legacy=0x7f28e806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 0x7f28d4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d4004810 0x7f28d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d40051c0 0x7f28d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815a700 con 0x7f28d4004810 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d400c160 con 0x7f28d4003bf0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d400c320 con 0x7f28d40051c0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28de59c700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d4004810 0x7f28d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 0x7f28d4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.544+0000 7f28e759e700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d40051c0 0x7f28d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 -- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d40051c0 msgr2=0x7f28d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d40051c0 0x7f28d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 -- 172.21.15.155:0/2427722372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d4004810 msgr2=0x7f28d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d4004810 0x7f28d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 -- 172.21.15.155:0/2427722372 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4003570 con 0x7f28d4003bf0 2024-08-17T02:28:04.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e759e700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d40051c0 0x7f28d400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e759e700 1 -- 172.21.15.155:0/2427722372 reap_dead start 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 0x7f28d4003fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28d8006f00 tx=0x7f28d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68f999ee121df7a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800e920 con 0x7f28d4003bf0 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800ea80 con 0x7f28d4003bf0 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28e659c700 1 -- 172.21.15.155:0/2427722372 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800ee40 con 0x7f28d4003bf0 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 msgr2=0x7f28d4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 0x7f28d4003fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28d8006f00 tx=0x7f28d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- 172.21.15.155:0/2427722372 shutdown_connections 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/2427722372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28d4003bf0 0x7f28d4003fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- 172.21.15.155:0/2427722372 >> 172.21.15.155:0/2427722372 conn(0x7f28e8067810 msgr2=0x7f28e8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- 172.21.15.155:0/2427722372 shutdown_connections 2024-08-17T02:28:04.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- 172.21.15.155:0/2427722372 wait complete. 2024-08-17T02:28:04.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 Processor -- start 2024-08-17T02:28:04.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.548+0000 7f28ed1a5700 1 -- start start 2024-08-17T02:28:04.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d4003bf0 0x7f28e814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28e814a760 0x7f28e814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b0cb0 con 0x7f28e80afc20 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81483d0 con 0x7f28e814a760 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e814b110 con 0x7f28d4003bf0 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42642/0 (socket says 172.21.15.155:42642) 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 -- 172.21.15.155:0/3830019412 learned_addr learned my addr 172.21.15.155:0/3830019412 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d4003bf0 0x7f28e814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28e759e700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28e814a760 0x7f28e814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 -- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d4003bf0 msgr2=0x7f28e814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d4003bf0 0x7f28e814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 -- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28e814a760 msgr2=0x7f28e814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28e814a760 0x7f28e814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 -- 172.21.15.155:0/3830019412 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80b0410 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28de59c700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001120 tx=0x7f28d0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0018030 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e80b06f0 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000f870 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e8147e40 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000fc10 con 0x7f28e80afc20 2024-08-17T02:28:04.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.552+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e8148580 con 0x7f28e80afc20 2024-08-17T02:28:04.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.556+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f28d001b070 con 0x7f28e80afc20 2024-08-17T02:28:04.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.556+0000 7f28df7fe700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 0x7f28c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.556+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f28d0019070 con 0x7f28e80afc20 2024-08-17T02:28:04.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.556+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 0x7f28c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.556+0000 7f28e6d9d700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 0x7f28c8062d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28d80093f0 tx=0x7f28d801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.564+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f28e8148580 con 0x7f28e80afc20 2024-08-17T02:28:04.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.792+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f28e8148580 con 0x7f28e80afc20 2024-08-17T02:28:04.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.800+0000 7f28df7fe700 1 -- 172.21.15.155:0/3830019412 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f28e8148580 con 0x7f28e80afc20 2024-08-17T02:28:04.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 msgr2=0x7f28c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 0x7f28c8062d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28d80093f0 tx=0x7f28d801a000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 msgr2=0x7f28e8147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001120 tx=0x7f28d0001e10 comp rx=0 tx=0).stop 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 shutdown_connections 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f28c8060890 0x7f28c8062d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28e814a760 0x7f28e814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28e80afc20 0x7f28e8147900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 --2- 172.21.15.155:0/3830019412 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f28d4003bf0 0x7f28e814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 >> 172.21.15.155:0/3830019412 conn(0x7f28e8067810 msgr2=0x7f28e8158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 shutdown_connections 2024-08-17T02:28:04.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.804+0000 7f28ed1a5700 1 -- 172.21.15.155:0/3830019412 wait complete. 2024-08-17T02:28:04.820 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 Processor -- start 2024-08-17T02:28:04.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 -- start start 2024-08-17T02:28:04.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5d48153320 0x7f5d481536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4815dbd0 con 0x7f5d480cd1b0 2024-08-17T02:28:04.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4815d370 con 0x7f5d4815a190 2024-08-17T02:28:04.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d47fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d480ce430 con 0x7f5d48153320 2024-08-17T02:28:04.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d477fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5d480cd1b0 0x7f5d480ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35640/0 (socket says 172.21.15.155:35640) 2024-08-17T02:28:04.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d477fe700 1 -- 172.21.15.155:0/2798418570 learned_addr learned my addr 172.21.15.155:0/2798418570 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:04.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d46ffd700 1 --2- 172.21.15.155:0/2798418570 >> v2:172.21.15.189:3300/0 conn(0x7f5d48153320 0x7f5d481536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167596699 0 0) 0x7f5d4815dbd0 con 0x7f5d480cd1b0 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003570 con 0x7f5d480cd1b0 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235916677 0 0) 0x7f5d4815d370 con 0x7f5d4815a190 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4815dbd0 con 0x7f5d4815a190 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d46ffd700 1 -- 172.21.15.155:0/2798418570 >> v1:172.21.15.189:6789/0 conn(0x7f5d4815a190 legacy=0x7f5d480ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d46ffd700 1 -- 172.21.15.155:0/2798418570 >> v1:172.21.15.155:6789/0 conn(0x7f5d480cd1b0 legacy=0x7f5d480ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89527733 0 0) 0x7f5d34003570 con 0x7f5d480cd1b0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.924+0000 7f5d46ffd700 1 -- 172.21.15.155:0/2798418570 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4815a590 con 0x7f5d48153320 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d46ffd700 1 --2- 172.21.15.155:0/2798418570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d481536f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d380098e0 tx=0x7f5d380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae634ee53a31ec0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d400017f0 con 0x7f5d48153320 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38011420 con 0x7f5d48153320 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d45ffb700 1 -- 172.21.15.155:0/2798418570 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380117c0 con 0x7f5d48153320 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 -- 172.21.15.155:0/2798418570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 msgr2=0x7f5d481536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2798418570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d481536f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d380098e0 tx=0x7f5d380091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 -- 172.21.15.155:0/2798418570 shutdown_connections 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2798418570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d481536f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 -- 172.21.15.155:0/2798418570 >> 172.21.15.155:0/2798418570 conn(0x7f5d480d00a0 msgr2=0x7f5d480d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 -- 172.21.15.155:0/2798418570 shutdown_connections 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 -- 172.21.15.155:0/2798418570 wait complete. 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.928+0000 7f5d47fff700 1 Processor -- start 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- start start 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d480cd1b0 0x7f5d480b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d48151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d48150e90 con 0x7f5d4815a190 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d481505e0 con 0x7f5d48153320 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d48150860 con 0x7f5d480cd1b0 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42648/0 (socket says 172.21.15.155:42648) 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 -- 172.21.15.155:0/2283873305 learned_addr learned my addr 172.21.15.155:0/2283873305 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d46ffd700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d480cd1b0 0x7f5d480b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d467fc700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d48151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 -- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d480cd1b0 msgr2=0x7f5d480b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d480cd1b0 0x7f5d480b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 -- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 msgr2=0x7f5d48151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d48151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 -- 172.21.15.155:0/2283873305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009420 con 0x7f5d4815a190 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d477fe700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000ccc0 tx=0x7f5d400018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40007e70 con 0x7f5d4815a190 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40004dc0 con 0x7f5d4815a190 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480c5cc0 con 0x7f5d4815a190 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000ab30 con 0x7f5d4815a190 2024-08-17T02:28:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.932+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480b5690 con 0x7f5d4815a190 2024-08-17T02:28:04.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d48151000 con 0x7f5d4815a190 2024-08-17T02:28:04.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5d40007150 con 0x7f5d4815a190 2024-08-17T02:28:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d3effd700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 0x7f5d28062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d46ffd700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 0x7f5d28062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5d4007c340 con 0x7f5d4815a190 2024-08-17T02:28:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.936+0000 7f5d46ffd700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 0x7f5d28062d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d380093f0 tx=0x7f5d38016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:04.944+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5d4004cac0 con 0x7f5d4815a190 2024-08-17T02:28:05.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.164+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5d480638f0 con 0x7f5d4815a190 2024-08-17T02:28:05.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.172+0000 7f5d3effd700 1 -- 172.21.15.155:0/2283873305 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5d400500e0 con 0x7f5d4815a190 2024-08-17T02:28:05.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 msgr2=0x7f5d28062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 0x7f5d28062d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d380093f0 tx=0x7f5d38016000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 msgr2=0x7f5d480b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000ccc0 tx=0x7f5d400018e0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 shutdown_connections 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5d28060890 0x7f5d28062d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4815a190 0x7f5d480b2e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48153320 0x7f5d48151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 --2- 172.21.15.155:0/2283873305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5d480cd1b0 0x7f5d480b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 >> 172.21.15.155:0/2283873305 conn(0x7f5d480d00a0 msgr2=0x7f5d4815b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 shutdown_connections 2024-08-17T02:28:05.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.176+0000 7f5d47fff700 1 -- 172.21.15.155:0/2283873305 wait complete. 2024-08-17T02:28:05.192 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:28:05.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.300+0000 7fa977fff700 1 Processor -- start 2024-08-17T02:28:05.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.300+0000 7fa977fff700 1 -- start start 2024-08-17T02:28:05.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 0x7fa9780686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 0x7fa978068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9781585b0 con 0x7fa978156c40 2024-08-17T02:28:05.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780c9fd0 con 0x7fa978157010 2024-08-17T02:28:05.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780cc320 con 0x7fa978157420 2024-08-17T02:28:05.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 0x7fa978068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa976ffd700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa978156c40 0x7fa9780cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:51978/0 (socket says 172.21.15.155:51978) 2024-08-17T02:28:05.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa976ffd700 1 -- 172.21.15.155:0/1840442040 learned_addr learned my addr 172.21.15.155:0/1840442040 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:05.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa96ffff700 1 --2- 172.21.15.155:0/1840442040 >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 0x7fa9780686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 -- 172.21.15.155:0/1840442040 >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 msgr2=0x7fa9780686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 --2- 172.21.15.155:0/1840442040 >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 0x7fa9780686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 -- 172.21.15.155:0/1840442040 >> v1:172.21.15.189:6789/0 conn(0x7fa978156c40 legacy=0x7fa9780cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9767fc700 1 -- 172.21.15.155:0/1840442040 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547423232 0 0) 0x7fa9781585b0 con 0x7fa978156c40 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 -- 172.21.15.155:0/1840442040 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9781579c0 con 0x7fa978157420 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa96ffff700 1 --2- 172.21.15.155:0/1840442040 >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 0x7fa9780686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9777fe700 1 --2- 172.21.15.155:0/1840442040 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 0x7fa978068be0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e60 tx=0x7fa970009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a7e98237075122 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9767fc700 1 -- 172.21.15.155:0/1840442040 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa978157420 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9767fc700 1 -- 172.21.15.155:0/1840442040 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000bb60 con 0x7fa978157420 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa9767fc700 1 -- 172.21.15.155:0/1840442040 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970012430 con 0x7fa978157420 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- 172.21.15.155:0/1840442040 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 msgr2=0x7fa978068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 --2- 172.21.15.155:0/1840442040 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 0x7fa978068be0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e60 tx=0x7fa970009780 comp rx=0 tx=0).stop 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- 172.21.15.155:0/1840442040 shutdown_connections 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 --2- 172.21.15.155:0/1840442040 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978157420 0x7fa978068be0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 --2- 172.21.15.155:0/1840442040 >> v2:172.21.15.189:3300/0 conn(0x7fa978157010 0x7fa9780686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- 172.21.15.155:0/1840442040 >> 172.21.15.155:0/1840442040 conn(0x7fa97806d800 msgr2=0x7fa97806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- 172.21.15.155:0/1840442040 shutdown_connections 2024-08-17T02:28:05.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.304+0000 7fa977fff700 1 -- 172.21.15.155:0/1840442040 wait complete. 2024-08-17T02:28:05.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 Processor -- start 2024-08-17T02:28:05.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- start start 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978156c40 0x7fa9780c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa978157010 0x7fa9780c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c6420 con 0x7fa978157420 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c5a50 con 0x7fa978157010 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c4e40 con 0x7fa978156c40 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa976ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978156c40 0x7fa9780c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42658/0 (socket says 172.21.15.155:42658) 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 -- 172.21.15.155:0/2751794997 learned_addr learned my addr 172.21.15.155:0/2751794997 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa96ffff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa978157010 0x7fa9780c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 -- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978156c40 msgr2=0x7fa9780c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978156c40 0x7fa9780c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 -- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa978157010 msgr2=0x7fa9780c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa978157010 0x7fa9780c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 -- 172.21.15.155:0/2751794997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009420 con 0x7fa978157420 2024-08-17T02:28:05.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa9777fe700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9780cc460 tx=0x7fa970019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970012ea0 con 0x7fa978157420 2024-08-17T02:28:05.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970027470 con 0x7fa978157420 2024-08-17T02:28:05.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970009a20 con 0x7fa978157420 2024-08-17T02:28:05.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970027830 con 0x7fa978157420 2024-08-17T02:28:05.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.308+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780c5400 con 0x7fa978157420 2024-08-17T02:28:05.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9780c5c00 con 0x7fa978157420 2024-08-17T02:28:05.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa970024070 con 0x7fa978157420 2024-08-17T02:28:05.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa96effd700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 0x7fa958062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa976ffd700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 0x7fa958062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa97007efd0 con 0x7fa978157420 2024-08-17T02:28:05.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.312+0000 7fa976ffd700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 0x7fa958062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9780c65d0 tx=0x7fa968007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.316+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa9780c5c00 con 0x7fa978157420 2024-08-17T02:28:05.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.540+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa9780c5bc0 con 0x7fa978157420 2024-08-17T02:28:05.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa96effd700 1 -- 172.21.15.155:0/2751794997 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa97004f770 con 0x7fa978157420 2024-08-17T02:28:05.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 msgr2=0x7fa958062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 0x7fa958062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9780c65d0 tx=0x7fa968007d30 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 msgr2=0x7fa9780c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9780cc460 tx=0x7fa970019000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 shutdown_connections 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa958060860 0x7fa958062d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978157420 0x7fa9780c6830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa978157010 0x7fa9780c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 --2- 172.21.15.155:0/2751794997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa978156c40 0x7fa9780c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 >> 172.21.15.155:0/2751794997 conn(0x7fa97806d800 msgr2=0x7fa97806aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 shutdown_connections 2024-08-17T02:28:05.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.548+0000 7fa977fff700 1 -- 172.21.15.155:0/2751794997 wait complete. 2024-08-17T02:28:05.567 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:28:05.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 Processor -- start 2024-08-17T02:28:05.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 -- start start 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7530155d20 0x7f75300b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f75300ad7c0 0x7f75300aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f753006df10 0x7f753006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75300adc10 con 0x7f753006df10 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753006e8d0 con 0x7f75300ad7c0 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.676+0000 7f752f59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75300af2b0 con 0x7f7530155d20 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f753006df10 0x7f753006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f753006df10 0x7f753006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42666/0 (socket says 172.21.15.155:42666) 2024-08-17T02:28:05.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 -- 172.21.15.155:0/3191848418 learned_addr learned my addr 172.21.15.155:0/3191848418 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:05.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752e59c700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7530155d20 0x7f75300b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f7525d9b700 1 --2- 172.21.15.155:0/3191848418 >> v2:172.21.15.189:3300/0 conn(0x7f75300ad7c0 0x7f75300aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 -- 172.21.15.155:0/3191848418 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7530155d20 msgr2=0x7f75300b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7530155d20 0x7f75300b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 -- 172.21.15.155:0/3191848418 >> v2:172.21.15.189:3300/0 conn(0x7f75300ad7c0 msgr2=0x7f75300aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 --2- 172.21.15.155:0/3191848418 >> v2:172.21.15.189:3300/0 conn(0x7f75300ad7c0 0x7f75300aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 -- 172.21.15.155:0/3191848418 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300af590 con 0x7f753006df10 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752ed9d700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753006df10 0x7f753006e390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7530070d00 tx=0x7f7528009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5d6993b408b896 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752dd9b700 1 -- 172.21.15.155:0/3191848418 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800e070 con 0x7f753006df10 2024-08-17T02:28:05.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752dd9b700 1 -- 172.21.15.155:0/3191848418 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800b930 con 0x7f753006df10 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752dd9b700 1 -- 172.21.15.155:0/3191848418 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280092e0 con 0x7f753006df10 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- 172.21.15.155:0/3191848418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753006df10 msgr2=0x7f753006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753006df10 0x7f753006e390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7530070d00 tx=0x7f7528009840 comp rx=0 tx=0).stop 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- 172.21.15.155:0/3191848418 shutdown_connections 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f753006df10 0x7f753006e390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 --2- 172.21.15.155:0/3191848418 >> v2:172.21.15.189:3300/0 conn(0x7f75300ad7c0 0x7f75300aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 --2- 172.21.15.155:0/3191848418 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7530155d20 0x7f75300b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- 172.21.15.155:0/3191848418 >> 172.21.15.155:0/3191848418 conn(0x7f75300678d0 msgr2=0x7f7530067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- 172.21.15.155:0/3191848418 shutdown_connections 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- 172.21.15.155:0/3191848418 wait complete. 2024-08-17T02:28:05.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 Processor -- start 2024-08-17T02:28:05.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.680+0000 7f752f59e700 1 -- start start 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f753006df10 0x7f75301376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75300ad7c0 0x7f753015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530137c10 con 0x7f7530155d20 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753015b830 con 0x7f753006df10 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753015ac20 con 0x7f75300ad7c0 2024-08-17T02:28:05.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42674/0 (socket says 172.21.15.155:42674) 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752e59c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f753006df10 0x7f75301376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 -- 172.21.15.155:0/4180113997 learned_addr learned my addr 172.21.15.155:0/4180113997 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f7525d9b700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75300ad7c0 0x7f753015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 -- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75300ad7c0 msgr2=0x7f753015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75300ad7c0 0x7f753015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 -- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f753006df10 msgr2=0x7f75301376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f753006df10 0x7f75301376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 -- 172.21.15.155:0/4180113997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528009ae0 con 0x7f7530155d20 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752ed9d700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7528009ab0 tx=0x7f7528018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528008ad0 con 0x7f7530155d20 2024-08-17T02:28:05.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7528008c50 con 0x7f7530155d20 2024-08-17T02:28:05.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528026460 con 0x7f7530155d20 2024-08-17T02:28:05.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753015af00 con 0x7f7530155d20 2024-08-17T02:28:05.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753015b4c0 con 0x7f7530155d20 2024-08-17T02:28:05.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.684+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753015b9e0 con 0x7f7530155d20 2024-08-17T02:28:05.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.688+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7528003040 con 0x7f7530155d20 2024-08-17T02:28:05.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.688+0000 7f7526ffd700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 0x7f7510062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.688+0000 7f752e59c700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 0x7f7510062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.688+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f752807e140 con 0x7f7530155d20 2024-08-17T02:28:05.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.688+0000 7f752e59c700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 0x7f7510062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7520009d10 tx=0x7f75200091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.692+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f753015b9e0 con 0x7f7530155d20 2024-08-17T02:28:05.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.912+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f753015b9a0 con 0x7f7530155d20 2024-08-17T02:28:05.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f7526ffd700 1 -- 172.21.15.155:0/4180113997 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f752804e990 con 0x7f7530155d20 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 msgr2=0x7f7510062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 0x7f7510062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7520009d10 tx=0x7f75200091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 msgr2=0x7f753015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7528009ab0 tx=0x7f7528018000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 shutdown_connections 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7510060860 0x7f7510062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530155d20 0x7f753015c5d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f75300ad7c0 0x7f753015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 --2- 172.21.15.155:0/4180113997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f753006df10 0x7f75301376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 >> 172.21.15.155:0/4180113997 conn(0x7f75300678d0 msgr2=0x7f753006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 shutdown_connections 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:05.920+0000 7f752f59e700 1 -- 172.21.15.155:0/4180113997 wait complete. 2024-08-17T02:28:05.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.040+0000 7fe353fff700 1 Processor -- start 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.040+0000 7fe353fff700 1 -- start start 2024-08-17T02:28:06.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe353fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe3540aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe353fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe3540aecc0 0x7fe35406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe353fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540ac000 con 0x7fe354159280 2024-08-17T02:28:06.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe353fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540ad4a0 con 0x7fe3540aecc0 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe353fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540ab3f0 con 0x7fe354158eb0 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3537fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe354159280 0x7fe3540a9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35652/0 (socket says 172.21.15.155:35652) 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3537fe700 1 -- 172.21.15.155:0/151044559 learned_addr learned my addr 172.21.15.155:0/151044559 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> v2:172.21.15.189:3300/0 conn(0x7fe3540aecc0 0x7fe35406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe352ffd700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe3540aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759525251 0 0) 0x7fe3540ac000 con 0x7fe354159280 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c003570 con 0x7fe354159280 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331003346 0 0) 0x7fe33c003570 con 0x7fe354159280 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 msgr2=0x7fe3540aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe3540aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 >> v2:172.21.15.189:3300/0 conn(0x7fe3540aecc0 msgr2=0x7fe35406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 --2- 172.21.15.155:0/151044559 >> v2:172.21.15.189:3300/0 conn(0x7fe3540aecc0 0x7fe35406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540ab6d0 con 0x7fe354159280 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fe34c0017f0 con 0x7fe354159280 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> v2:172.21.15.189:3300/0 conn(0x7fe3540aecc0 0x7fe35406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 >> v1:172.21.15.155:6789/0 conn(0x7fe354159280 legacy=0x7fe3540a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe33c003a60 0x7fe33c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe33c004810 0x7fe33c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe33c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540ad4a0 con 0x7fe33c004810 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540ab3f0 con 0x7fe33c003a60 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c00ba60 con 0x7fe354158eb0 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe33c004810 0x7fe33c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe352ffd700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe33c003a60 0x7fe33c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3537fe700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe33c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 -- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 msgr2=0x7fe33c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe354158eb0 0x7fe33c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 -- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe33c003a60 msgr2=0x7fe33c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe33c003a60 0x7fe33c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 -- 172.21.15.155:0/151044559 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c003570 con 0x7fe33c004810 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe352ffd700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe33c003a60 0x7fe33c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe3527fc700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe33c004810 0x7fe33c004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe348009e20 tx=0x7fe3480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d1b99c089e4d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e920 con 0x7fe33c004810 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800ea80 con 0x7fe33c004810 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.044+0000 7fe351ffb700 1 -- 172.21.15.155:0/151044559 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800ee20 con 0x7fe33c004810 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- 172.21.15.155:0/151044559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe33c004810 msgr2=0x7fe33c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 --2- 172.21.15.155:0/151044559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe33c004810 0x7fe33c004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe348009e20 tx=0x7fe3480091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe3537fe700 1 -- 172.21.15.155:0/151044559 reap_dead start 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- 172.21.15.155:0/151044559 shutdown_connections 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- 172.21.15.155:0/151044559 >> 172.21.15.155:0/151044559 conn(0x7fe3540678d0 msgr2=0x7fe354067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- 172.21.15.155:0/151044559 shutdown_connections 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- 172.21.15.155:0/151044559 wait complete. 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 Processor -- start 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- start start 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe35414b050 0x7fe35414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3541506d0 0x7fe35414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c8720 con 0x7fe354150300 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c8a00 con 0x7fe3541506d0 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe353fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c8ce0 con 0x7fe35414b050 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe352ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe352ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42686/0 (socket says 172.21.15.155:42686) 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe352ffd700 1 -- 172.21.15.155:0/1961503804 learned_addr learned my addr 172.21.15.155:0/1961503804 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.048+0000 7fe3527fc700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe35414b050 0x7fe35414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe3537fe700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3541506d0 0x7fe35414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 -- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe35414b050 msgr2=0x7fe35414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe35414b050 0x7fe35414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 -- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3541506d0 msgr2=0x7fe35414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3541506d0 0x7fe35414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 -- 172.21.15.155:0/1961503804 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540c8fc0 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe352ffd700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe344011d70 tx=0x7fe3440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344011ed0 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34400fbc0 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3540c92a0 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34401d480 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35414e6a0 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35414e950 con 0x7fe354150300 2024-08-17T02:28:06.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe34401d8b0 con 0x7fe354150300 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 0x7fe340062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe344018070 con 0x7fe354150300 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.052+0000 7fe3527fc700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 0x7fe340062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.056+0000 7fe3527fc700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 0x7fe340062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3540642d0 tx=0x7fe34801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.064+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe34404de20 con 0x7fe354150300 2024-08-17T02:28:06.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.216+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3540643a0 con 0x7fe354150300 2024-08-17T02:28:06.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe33affd700 1 -- 172.21.15.155:0/1961503804 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7fe344051440 con 0x7fe354150300 2024-08-17T02:28:06.223 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:06.223 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":28,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:28:03.295743+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:06.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 msgr2=0x7fe340062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 0x7fe340062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3540642d0 tx=0x7fe34801a000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 msgr2=0x7fe35414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe344011d70 tx=0x7fe3440091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 shutdown_connections 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe340060860 0x7fe340062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3541506d0 0x7fe35414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.220+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe35414b050 0x7fe35414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.224+0000 7fe353fff700 1 --2- 172.21.15.155:0/1961503804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe354150300 0x7fe35414ab10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.224+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 >> 172.21.15.155:0/1961503804 conn(0x7fe3540678d0 msgr2=0x7fe354149940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.224+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 shutdown_connections 2024-08-17T02:28:06.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.224+0000 7fe353fff700 1 -- 172.21.15.155:0/1961503804 wait complete. 2024-08-17T02:28:06.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:28:06.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:06.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 Processor -- start 2024-08-17T02:28:06.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 -- start start 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 0x7f5324066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240ce210 con 0x7f5324159480 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532415dc20 con 0x7f53240cd2b0 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.344+0000 7f532ae9c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240cba00 con 0x7f53241590b0 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329699700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5324159480 0x7f532415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35660/0 (socket says 172.21.15.155:35660) 2024-08-17T02:28:06.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329699700 1 -- 172.21.15.155:0/1431152288 learned_addr learned my addr 172.21.15.155:0/1431152288 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329e9a700 1 --2- 172.21.15.155:0/1431152288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 0x7f5324066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599801885 0 0) 0x7f53240ce210 con 0x7f5324159480 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5310003570 con 0x7f5324159480 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878930569 0 0) 0x7f532415dc20 con 0x7f53240cd2b0 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53240ce210 con 0x7f53240cd2b0 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329e9a700 1 -- 172.21.15.155:0/1431152288 >> v1:172.21.15.189:6789/0 conn(0x7f53240cd2b0 legacy=0x7f532415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329e9a700 1 -- 172.21.15.155:0/1431152288 >> v1:172.21.15.155:6789/0 conn(0x7f5324159480 legacy=0x7f532415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329e9a700 1 -- 172.21.15.155:0/1431152288 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240cb440 con 0x7f53241590b0 2024-08-17T02:28:06.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5329e9a700 1 --2- 172.21.15.155:0/1431152288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 0x7f5324066e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5314009910 tx=0x7f53140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713483411859f027 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011630 con 0x7f53241590b0 2024-08-17T02:28:06.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314011790 con 0x7f53241590b0 2024-08-17T02:28:06.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f5328e98700 1 -- 172.21.15.155:0/1431152288 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011b30 con 0x7f53241590b0 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 -- 172.21.15.155:0/1431152288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 msgr2=0x7f5324066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 --2- 172.21.15.155:0/1431152288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 0x7f5324066e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5314009910 tx=0x7f53140091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 -- 172.21.15.155:0/1431152288 shutdown_connections 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 --2- 172.21.15.155:0/1431152288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f53241590b0 0x7f5324066e00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 -- 172.21.15.155:0/1431152288 >> 172.21.15.155:0/1431152288 conn(0x7f53240d0b90 msgr2=0x7f53240ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 -- 172.21.15.155:0/1431152288 shutdown_connections 2024-08-17T02:28:06.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.348+0000 7f532ae9c700 1 -- 172.21.15.155:0/1431152288 wait complete. 2024-08-17T02:28:06.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 Processor -- start 2024-08-17T02:28:06.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 -- start start 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 0x7f532414c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5324159480 0x7f532416cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240b4460 con 0x7f53240cd2b0 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532414cf10 con 0x7f53241590b0 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532ae9c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240b3b30 con 0x7f5324159480 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f5329e9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f5329e9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42700/0 (socket says 172.21.15.155:42700) 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f5329e9a700 1 -- 172.21.15.155:0/3997604809 learned_addr learned my addr 172.21.15.155:0/3997604809 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f532a69b700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5324159480 0x7f532416cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.352+0000 7f5329699700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 0x7f532414c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 -- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5324159480 msgr2=0x7f532416cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5324159480 0x7f532416cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 -- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 msgr2=0x7f532414c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 0x7f532414c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 -- 172.21.15.155:0/3997604809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009420 con 0x7f53240cd2b0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329699700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 0x7f532414c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5329e9a700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5314009fd0 tx=0x7f5314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531401f070 con 0x7f53240cd2b0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314000bc0 con 0x7f53240cd2b0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011b30 con 0x7f53240cd2b0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240b3e10 con 0x7f53240cd2b0 2024-08-17T02:28:06.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240b3840 con 0x7f53240cd2b0 2024-08-17T02:28:06.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5324064330 con 0x7f53240cd2b0 2024-08-17T02:28:06.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5314023070 con 0x7f53240cd2b0 2024-08-17T02:28:06.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.356+0000 7f5319ffb700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 0x7f5308062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.360+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f531407dc70 con 0x7f53240cd2b0 2024-08-17T02:28:06.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.360+0000 7f5329699700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 0x7f5308062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.360+0000 7f5329699700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 0x7f5308062de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53240c75c0 tx=0x7f5320009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.364+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f531404e3f0 con 0x7f53240cd2b0 2024-08-17T02:28:06.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.528+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5324150b00 con 0x7f53240cd2b0 2024-08-17T02:28:06.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.532+0000 7f5319ffb700 1 -- 172.21.15.155:0/3997604809 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53140150a0 con 0x7f53240cd2b0 2024-08-17T02:28:06.534 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 msgr2=0x7f5308062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 0x7f5308062de0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53240c75c0 tx=0x7f5320009040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 msgr2=0x7f53240b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5314009fd0 tx=0x7f5314017000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 shutdown_connections 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5308060930 0x7f5308062de0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5324159480 0x7f532416cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53241590b0 0x7f532414c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 --2- 172.21.15.155:0/3997604809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd2b0 0x7f53240b51f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 >> 172.21.15.155:0/3997604809 conn(0x7f53240d0b90 msgr2=0x7f53240b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 shutdown_connections 2024-08-17T02:28:06.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.536+0000 7f532ae9c700 1 -- 172.21.15.155:0/3997604809 wait complete. 2024-08-17T02:28:06.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:28:06.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 Processor -- start 2024-08-17T02:28:06.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 -- start start 2024-08-17T02:28:06.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f81740b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f81740ad7c0 0x7f81740aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81740af2b0 con 0x7f817406df10 2024-08-17T02:28:06.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81740adc10 con 0x7f81740ad7c0 2024-08-17T02:28:06.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a8f4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81740af590 con 0x7f8174155d20 2024-08-17T02:28:06.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a0f3700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f817406df10 0x7f81741599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35666/0 (socket says 172.21.15.155:35666) 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f817a0f3700 1 -- 172.21.15.155:0/169036538 learned_addr learned my addr 172.21.15.155:0/169036538 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f81798f2700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f81740b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.656+0000 7f81790f1700 1 --2- 172.21.15.155:0/169036538 >> v2:172.21.15.189:3300/0 conn(0x7f81740ad7c0 0x7f81740aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647193934 0 0) 0x7f81740af2b0 con 0x7f817406df10 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f815c003570 con 0x7f817406df10 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044495313 0 0) 0x7f815c003570 con 0x7f817406df10 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 msgr2=0x7f81740b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f81740b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 >> v2:172.21.15.189:3300/0 conn(0x7f81740ad7c0 msgr2=0x7f81740aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 --2- 172.21.15.155:0/169036538 >> v2:172.21.15.189:3300/0 conn(0x7f81740ad7c0 0x7f81740aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740af870 con 0x7f817406df10 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f816c001470 con 0x7f817406df10 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 >> v1:172.21.15.155:6789/0 conn(0x7f817406df10 legacy=0x7f81741599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f815c003a60 0x7f815c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c004810 0x7f815c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f815c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740adc10 con 0x7f815c003a60 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740af590 con 0x7f815c004810 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c00ba60 con 0x7f8174155d20 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f815c003a60 0x7f815c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a0f3700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f815c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81790f1700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c004810 0x7f815c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 -- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 msgr2=0x7f815c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8174155d20 0x7f815c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 -- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c004810 msgr2=0x7f815c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c004810 0x7f815c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 -- 172.21.15.155:0/169036538 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c003570 con 0x7f815c003a60 2024-08-17T02:28:06.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81790f1700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c004810 0x7f815c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81798f2700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f815c003a60 0x7f815c003e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8164009c30 tx=0x7f81640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319dd4159b2704e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816400e710 con 0x7f815c003a60 2024-08-17T02:28:06.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816400e870 con 0x7f815c003a60 2024-08-17T02:28:06.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f81788f0700 1 -- 172.21.15.155:0/169036538 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816400ec30 con 0x7f815c003a60 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 -- 172.21.15.155:0/169036538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f815c003a60 msgr2=0x7f815c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 --2- 172.21.15.155:0/169036538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f815c003a60 0x7f815c003e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8164009c30 tx=0x7f81640091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a0f3700 1 -- 172.21.15.155:0/169036538 reap_dead start 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 -- 172.21.15.155:0/169036538 shutdown_connections 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 -- 172.21.15.155:0/169036538 >> 172.21.15.155:0/169036538 conn(0x7f81740678d0 msgr2=0x7f8174067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 -- 172.21.15.155:0/169036538 shutdown_connections 2024-08-17T02:28:06.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.660+0000 7f817a8f4700 1 -- 172.21.15.155:0/169036538 wait complete. 2024-08-17T02:28:06.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 Processor -- start 2024-08-17T02:28:06.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 -- start start 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 0x7f8174150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8174150850 0x7f81740ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740a8d70 con 0x7f817416a0c0 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174150ca0 con 0x7f8174150850 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a8f4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8174154ef0 con 0x7f81740a7ba0 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42720/0 (socket says 172.21.15.155:42720) 2024-08-17T02:28:06.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 -- 172.21.15.155:0/95143825 learned_addr learned my addr 172.21.15.155:0/95143825 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f817a0f3700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8174150850 0x7f81740ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81790f1700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 0x7f8174150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 -- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 msgr2=0x7f8174150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 0x7f8174150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 -- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8174150850 msgr2=0x7f81740ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8174150850 0x7f81740ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81798f2700 1 -- 172.21.15.155:0/95143825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740a8160 con 0x7f817416a0c0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.664+0000 7f81790f1700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 0x7f8174150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f81798f2700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f816400e4b0 tx=0x7f816401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164023070 con 0x7f817416a0c0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816400e9e0 con 0x7f817416a0c0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740a8440 con 0x7f817416a0c0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816401e030 con 0x7f817416a0c0 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740a8a00 con 0x7f817416a0c0 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81740a8ee0 con 0x7f817416a0c0 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f816401e1b0 con 0x7f817416a0c0 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 0x7f8160062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f816407e100 con 0x7f817416a0c0 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f81790f1700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 0x7f8160062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.668+0000 7f81790f1700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 0x7f8160062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f817406c320 tx=0x7f816800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.676+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f816404e800 con 0x7f817416a0c0 2024-08-17T02:28:06.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.844+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8174167280 con 0x7f817416a0c0 2024-08-17T02:28:06.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.844+0000 7f8171ffb700 1 -- 172.21.15.155:0/95143825 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8164051e20 con 0x7f817416a0c0 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout: "poolnum": 1, 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout: "poolname": ".mgr" 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:06.848 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 msgr2=0x7f8160062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 0x7f8160062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f817406c320 tx=0x7f816800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 msgr2=0x7f81740a7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f816400e4b0 tx=0x7f816401a000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 shutdown_connections 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f8160060890 0x7f8160062d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8174150850 0x7f81740ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f81740a7ba0 0x7f8174150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 --2- 172.21.15.155:0/95143825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817416a0c0 0x7f81740a7660 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 >> 172.21.15.155:0/95143825 conn(0x7f81740678d0 msgr2=0x7f817406e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 shutdown_connections 2024-08-17T02:28:06.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.848+0000 7f817a8f4700 1 -- 172.21.15.155:0/95143825 wait complete. 2024-08-17T02:28:06.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:28:06.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:28:06.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 Processor -- start 2024-08-17T02:28:06.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 -- start start 2024-08-17T02:28:06.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac8c157360 0x7fac8c0a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fac8c0a9fc0 0x7fac8c0aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0c9f50 con 0x7fac8c0a8fd0 2024-08-17T02:28:06.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0a9c30 con 0x7fac8c157360 2024-08-17T02:28:06.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac916ac700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0ab3f0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac8c157360 0x7fac8c0a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac8c157360 0x7fac8c0a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42728/0 (socket says 172.21.15.155:42728) 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 -- 172.21.15.155:0/337899912 learned_addr learned my addr 172.21.15.155:0/337899912 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8affd700 1 --1- 172.21.15.155:0/337899912 >> v1:172.21.15.155:6789/0 conn(0x7fac8c0a8fd0 0x7fac8c156c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35678/0 (socket says 172.21.15.155:35678) 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8b7fe700 1 --2- 172.21.15.155:0/337899912 >> v2:172.21.15.189:3300/0 conn(0x7fac8c0a9fc0 0x7fac8c0aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 -- 172.21.15.155:0/337899912 >> v2:172.21.15.189:3300/0 conn(0x7fac8c0a9fc0 msgr2=0x7fac8c0aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 --2- 172.21.15.155:0/337899912 >> v2:172.21.15.189:3300/0 conn(0x7fac8c0a9fc0 0x7fac8c0aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 -- 172.21.15.155:0/337899912 >> v1:172.21.15.155:6789/0 conn(0x7fac8c0a8fd0 legacy=0x7fac8c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 -- 172.21.15.155:0/337899912 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0ab8f0 con 0x7fac8c157360 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.972+0000 7fac8a7fc700 1 --2- 172.21.15.155:0/337899912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c157360 0x7fac8c0a93a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0aebb0 tx=0x7fac84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5224d50e97e99ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac89ffb700 1 -- 172.21.15.155:0/337899912 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400e070 con 0x7fac8c157360 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac89ffb700 1 -- 172.21.15.155:0/337899912 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8400ba40 con 0x7fac8c157360 2024-08-17T02:28:06.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac89ffb700 1 -- 172.21.15.155:0/337899912 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840092e0 con 0x7fac8c157360 2024-08-17T02:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 -- 172.21.15.155:0/337899912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c157360 msgr2=0x7fac8c0a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 --2- 172.21.15.155:0/337899912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c157360 0x7fac8c0a93a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0aebb0 tx=0x7fac84009840 comp rx=0 tx=0).stop 2024-08-17T02:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 -- 172.21.15.155:0/337899912 shutdown_connections 2024-08-17T02:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 --2- 172.21.15.155:0/337899912 >> v2:172.21.15.189:3300/0 conn(0x7fac8c0a9fc0 0x7fac8c0aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 --2- 172.21.15.155:0/337899912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c157360 0x7fac8c0a93a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 -- 172.21.15.155:0/337899912 >> 172.21.15.155:0/337899912 conn(0x7fac8c0c93a0 msgr2=0x7fac8c066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 -- 172.21.15.155:0/337899912 shutdown_connections 2024-08-17T02:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.976+0000 7fac916ac700 1 -- 172.21.15.155:0/337899912 wait complete. 2024-08-17T02:28:06.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 Processor -- start 2024-08-17T02:28:06.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 -- start start 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 0x7fac8c0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fac8c157360 0x7fac8c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0af740 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0b1c10 con 0x7fac8c0a8fd0 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac916ac700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0aee10 con 0x7fac8c157360 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8affd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 0x7fac8c0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42730/0 (socket says 172.21.15.155:42730) 2024-08-17T02:28:06.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 -- 172.21.15.155:0/2092119171 learned_addr learned my addr 172.21.15.155:0/2092119171 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:06.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8b7fe700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fac8c157360 0x7fac8c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 -- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fac8c157360 msgr2=0x7fac8c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fac8c157360 0x7fac8c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 -- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 msgr2=0x7fac8c0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 0x7fac8c0b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 -- 172.21.15.155:0/2092119171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009ae0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8affd700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 0x7fac8c0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac8a7fc700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac84009880 tx=0x7fac84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84007920 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.980+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84007ae0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84007ea0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c0af0f0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c15b7b0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c0af8f0 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fac84003040 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac82ffd700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 0x7fac6c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fac8407e110 con 0x7fac8c0a9fc0 2024-08-17T02:28:06.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac8affd700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 0x7fac6c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.984+0000 7fac8affd700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 0x7fac6c062d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac8c16a9e0 tx=0x7fac74007eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:06.992+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fac8c0af8f0 con 0x7fac8c0a9fc0 2024-08-17T02:28:07.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.156+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fac8c0638f0 con 0x7fac8c0a9fc0 2024-08-17T02:28:07.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.928+0000 7fac82ffd700 1 -- 172.21.15.155:0/2092119171 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fac8404e8b0 con 0x7fac8c0a9fc0 2024-08-17T02:28:07.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 msgr2=0x7fac6c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 0x7fac6c062d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac8c16a9e0 tx=0x7fac74007eb0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 msgr2=0x7fac8c16b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac84009880 tx=0x7fac84018000 comp rx=0 tx=0).stop 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 shutdown_connections 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fac6c060890 0x7fac6c062d40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fac8c157360 0x7fac8c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a9fc0 0x7fac8c16b490 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 --2- 172.21.15.155:0/2092119171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c0a8fd0 0x7fac8c0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 >> 172.21.15.155:0/2092119171 conn(0x7fac8c0c93a0 msgr2=0x7fac8c156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 shutdown_connections 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:07.932+0000 7fac916ac700 1 -- 172.21.15.155:0/2092119171 wait complete. 2024-08-17T02:28:07.937 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' created 2024-08-17T02:28:07.949 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:28:08.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 Processor -- start 2024-08-17T02:28:08.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 -- start start 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd9c815b350 0x7fd9c80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9c80cc630 0x7fd9c80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80ccb80 con 0x7fd9c8156fc0 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80cce60 con 0x7fd9c80cc630 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cfc2d700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80cd140 con 0x7fd9c815b350 2024-08-17T02:28:08.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9ce1ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9c80cc630 0x7fd9c80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9ce1ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9c80cc630 0x7fd9c80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42742/0 (socket says 172.21.15.155:42742) 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9ce1ca700 1 -- 172.21.15.155:0/666747935 learned_addr learned my addr 172.21.15.155:0/666747935 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.060+0000 7fd9cd1c8700 1 --2- 172.21.15.155:0/666747935 >> v2:172.21.15.189:3300/0 conn(0x7fd9c815b350 0x7fd9c80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 -- 172.21.15.155:0/666747935 >> v2:172.21.15.189:3300/0 conn(0x7fd9c815b350 msgr2=0x7fd9c80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 --2- 172.21.15.155:0/666747935 >> v2:172.21.15.189:3300/0 conn(0x7fd9c815b350 0x7fd9c80b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 -- 172.21.15.155:0/666747935 >> v1:172.21.15.189:6789/0 conn(0x7fd9c8156fc0 legacy=0x7fd9c815ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 -- 172.21.15.155:0/666747935 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80cd420 con 0x7fd9c80cc630 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 --2- 172.21.15.155:0/666747935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80b2450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8071060 tx=0x7fd9c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520dfd296098c543 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cc9c7700 1 -- 172.21.15.155:0/666747935 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000e070 con 0x7fd9c80cc630 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cc9c7700 1 -- 172.21.15.155:0/666747935 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000ba10 con 0x7fd9c80cc630 2024-08-17T02:28:08.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cc9c7700 1 -- 172.21.15.155:0/666747935 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00092e0 con 0x7fd9c80cc630 2024-08-17T02:28:08.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/666747935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 msgr2=0x7fd9c80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/666747935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80b2450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8071060 tx=0x7fd9c0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:08.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/666747935 shutdown_connections 2024-08-17T02:28:08.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/666747935 >> v2:172.21.15.189:3300/0 conn(0x7fd9c815b350 0x7fd9c80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/666747935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80b2450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/666747935 >> 172.21.15.155:0/666747935 conn(0x7fd9c80cab30 msgr2=0x7fd9c80caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/666747935 shutdown_connections 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/666747935 wait complete. 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 Processor -- start 2024-08-17T02:28:08.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- start start 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 0x7fd9c806b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9c815b350 0x7fd9c806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c806c1a0 con 0x7fd9c80cc630 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9dc0 con 0x7fd9c8156fc0 2024-08-17T02:28:08.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cfc2d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c91b0 con 0x7fd9c815b350 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cd9c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cd9c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42756/0 (socket says 172.21.15.155:42756) 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cd9c9700 1 -- 172.21.15.155:0/3579493446 learned_addr learned my addr 172.21.15.155:0/3579493446 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9cd1c8700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 0x7fd9c806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.064+0000 7fd9ce1ca700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9c815b350 0x7fd9c806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 -- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9c815b350 msgr2=0x7fd9c806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9c815b350 0x7fd9c806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 -- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 msgr2=0x7fd9c806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 0x7fd9c806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 -- 172.21.15.155:0/3579493446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009ae0 con 0x7fd9c80cc630 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd1c8700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 0x7fd9c806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cd9c9700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c5d0 tx=0x7fd9b8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8011590 con 0x7fd9c80cc630 2024-08-17T02:28:08.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c80c9490 con 0x7fd9c80cc630 2024-08-17T02:28:08.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8011710 con 0x7fd9c80cc630 2024-08-17T02:28:08.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8011ad0 con 0x7fd9c80cc630 2024-08-17T02:28:08.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c80c9a50 con 0x7fd9c80cc630 2024-08-17T02:28:08.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.068+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c80645c0 con 0x7fd9c80cc630 2024-08-17T02:28:08.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.072+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd9b801c460 con 0x7fd9c80cc630 2024-08-17T02:28:08.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.072+0000 7fd9bdffb700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 0x7fd9ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.072+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd9b807c6c0 con 0x7fd9c80cc630 2024-08-17T02:28:08.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.072+0000 7fd9cd1c8700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 0x7fd9ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.072+0000 7fd9cd1c8700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 0x7fd9ac062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4006fd0 tx=0x7fd9c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.080+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd9b804ccf0 con 0x7fd9c80cc630 2024-08-17T02:28:08.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.240+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd9c80cd7c0 con 0x7fd9c80cc630 2024-08-17T02:28:08.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.936+0000 7fd9bdffb700 1 -- 172.21.15.155:0/3579493446 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd9b8050310 con 0x7fd9c80cc630 2024-08-17T02:28:08.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 msgr2=0x7fd9ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 0x7fd9ac062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4006fd0 tx=0x7fd9c4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:08.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 msgr2=0x7fd9c80afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c5d0 tx=0x7fd9b8007f60 comp rx=0 tx=0).stop 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 shutdown_connections 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd9ac060860 0x7fd9ac062d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd9c815b350 0x7fd9c806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd9c8156fc0 0x7fd9c806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 --2- 172.21.15.155:0/3579493446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c80cc630 0x7fd9c80afc10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 >> 172.21.15.155:0/3579493446 conn(0x7fd9c80cab30 msgr2=0x7fd9c8155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 shutdown_connections 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:08.960+0000 7fd9cfc2d700 1 -- 172.21.15.155:0/3579493446 wait complete. 2024-08-17T02:28:08.966 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' created 2024-08-17T02:28:08.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:28:09.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 Processor -- start 2024-08-17T02:28:09.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 -- start start 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240ace30 con 0x7fa324152bd0 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa324156dd0 con 0x7fa3240b1830 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa323fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240b1c80 con 0x7fa32406ead0 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa3237fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa324152bd0 0x7fa324153010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35686/0 (socket says 172.21.15.155:35686) 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa3237fe700 1 -- 172.21.15.155:0/744991381 learned_addr learned my addr 172.21.15.155:0/744991381 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa322ffd700 1 --2- 172.21.15.155:0/744991381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841883627 0 0) 0x7fa3240ace30 con 0x7fa324152bd0 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa30c003570 con 0x7fa324152bd0 2024-08-17T02:28:09.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003033255 0 0) 0x7fa324156dd0 con 0x7fa3240b1830 2024-08-17T02:28:09.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3240ace30 con 0x7fa3240b1830 2024-08-17T02:28:09.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa322ffd700 1 -- 172.21.15.155:0/744991381 >> v1:172.21.15.189:6789/0 conn(0x7fa3240b1830 legacy=0x7fa324155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa322ffd700 1 -- 172.21.15.155:0/744991381 >> v1:172.21.15.155:6789/0 conn(0x7fa324152bd0 legacy=0x7fa324153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa322ffd700 1 -- 172.21.15.155:0/744991381 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324156450 con 0x7fa32406ead0 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.080+0000 7fa322ffd700 1 --2- 172.21.15.155:0/744991381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32406eea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009e90 tx=0x7fa31c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7abac4d30f3906 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00e070 con 0x7fa32406ead0 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c00bb80 con 0x7fa32406ead0 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa321ffb700 1 -- 172.21.15.155:0/744991381 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c012430 con 0x7fa32406ead0 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- 172.21.15.155:0/744991381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 msgr2=0x7fa32406eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 --2- 172.21.15.155:0/744991381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32406eea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009e90 tx=0x7fa31c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- 172.21.15.155:0/744991381 shutdown_connections 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 --2- 172.21.15.155:0/744991381 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32406eea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- 172.21.15.155:0/744991381 >> 172.21.15.155:0/744991381 conn(0x7fa3240678a0 msgr2=0x7fa324067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- 172.21.15.155:0/744991381 shutdown_connections 2024-08-17T02:28:09.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- 172.21.15.155:0/744991381 wait complete. 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 Processor -- start 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 -- start start 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32413f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.084+0000 7fa323fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3240b1830 0x7fa3241576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240a6bb0 con 0x7fa324152bd0 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324141470 con 0x7fa3240b1830 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa324141750 con 0x7fa32406ead0 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42764/0 (socket says 172.21.15.155:42764) 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 -- 172.21.15.155:0/2017337177 learned_addr learned my addr 172.21.15.155:0/2017337177 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa322ffd700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32413f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3227fc700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3240b1830 0x7fa3241576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 -- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 msgr2=0x7fa32413f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32413f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 -- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3240b1830 msgr2=0x7fa3241576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3240b1830 0x7fa3241576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 -- 172.21.15.155:0/2017337177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c009a20 con 0x7fa324152bd0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa3237fe700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c790 tx=0x7fa314007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314005c00 con 0x7fa324152bd0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314005d80 con 0x7fa324152bd0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa324141a30 con 0x7fa324152bd0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314007320 con 0x7fa324152bd0 2024-08-17T02:28:09.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324141ff0 con 0x7fa324152bd0 2024-08-17T02:28:09.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.088+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa324064330 con 0x7fa324152bd0 2024-08-17T02:28:09.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.092+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa314007690 con 0x7fa324152bd0 2024-08-17T02:28:09.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.092+0000 7fa30affd700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 0x7fa310062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.092+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa31407bf80 con 0x7fa324152bd0 2024-08-17T02:28:09.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.092+0000 7fa322ffd700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 0x7fa310062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.092+0000 7fa322ffd700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 0x7fa310062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009de0 tx=0x7fa31c019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.096+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa31404c430 con 0x7fa324152bd0 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.296+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3240af600 con 0x7fa324152bd0 2024-08-17T02:28:09.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.944+0000 7fa30affd700 1 -- 172.21.15.155:0/2017337177 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa3140170c0 con 0x7fa324152bd0 2024-08-17T02:28:09.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 msgr2=0x7fa310062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 0x7fa310062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009de0 tx=0x7fa31c019000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 msgr2=0x7fa324157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c790 tx=0x7fa314007dd0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 shutdown_connections 2024-08-17T02:28:09.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.956+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa310060860 0x7fa310062d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.960+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa324152bd0 0x7fa324157be0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.964+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3240b1830 0x7fa3241576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.964+0000 7fa323fff700 1 --2- 172.21.15.155:0/2017337177 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32406ead0 0x7fa32413f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.964+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 >> 172.21.15.155:0/2017337177 conn(0x7fa3240678a0 msgr2=0x7fa324146670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.964+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 shutdown_connections 2024-08-17T02:28:09.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:09.964+0000 7fa323fff700 1 -- 172.21.15.155:0/2017337177 wait complete. 2024-08-17T02:28:09.972 INFO:teuthology.orchestra.run.smithi155.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:28:09.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:10.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 Processor -- start 2024-08-17T02:28:10.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 -- start start 2024-08-17T02:28:10.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fabb015d540 0x7fabb00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00b0270 con 0x7fabb006e830 2024-08-17T02:28:10.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb00af660 con 0x7fabb015d540 2024-08-17T02:28:10.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabb4d68700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00af940 con 0x7fabb00a9430 2024-08-17T02:28:10.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fabb015d540 0x7fabb00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabadd9b700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fabb006e830 0x7fabb00a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:52018/0 (socket says 172.21.15.155:52018) 2024-08-17T02:28:10.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabadd9b700 1 -- 172.21.15.155:0/269706535 learned_addr learned my addr 172.21.15.155:0/269706535 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:10.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabaed9d700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 -- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 msgr2=0x7fabb00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 -- 172.21.15.155:0/269706535 >> v1:172.21.15.189:6789/0 conn(0x7fabb006e830 legacy=0x7fabb00a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 -- 172.21.15.155:0/269706535 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00afc20 con 0x7fabb015d540 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabae59c700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb015d540 0x7fabb00af030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faba00098e0 tx=0x7faba00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab3581c9df0ca06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabad59a700 1 -- 172.21.15.155:0/269706535 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000b640 con 0x7fabb015d540 2024-08-17T02:28:10.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabad59a700 1 -- 172.21.15.155:0/269706535 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba000b7a0 con 0x7fabb015d540 2024-08-17T02:28:10.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.072+0000 7fabad59a700 1 -- 172.21.15.155:0/269706535 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000bb40 con 0x7fabb015d540 2024-08-17T02:28:10.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb015d540 msgr2=0x7fabb00af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb015d540 0x7fabb00af030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faba00098e0 tx=0x7faba00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- 172.21.15.155:0/269706535 shutdown_connections 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- 172.21.15.155:0/269706535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb015d540 0x7fabb00af030 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- 172.21.15.155:0/269706535 >> 172.21.15.155:0/269706535 conn(0x7fabb0066e00 msgr2=0x7fabb0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- 172.21.15.155:0/269706535 shutdown_connections 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- 172.21.15.155:0/269706535 wait complete. 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 Processor -- start 2024-08-17T02:28:10.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- start start 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 0x7fabb0157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb016d7a0 con 0x7fabb015d540 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00aaf70 con 0x7fabb006e830 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabb4d68700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00ab250 con 0x7fabb00a9430 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabaed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabadd9b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabaed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42770/0 (socket says 172.21.15.155:42770) 2024-08-17T02:28:10.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabaed9d700 1 -- 172.21.15.155:0/3122251862 learned_addr learned my addr 172.21.15.155:0/3122251862 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:10.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.076+0000 7fabae59c700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 0x7fabb0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 -- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 msgr2=0x7fabb00ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 -- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 msgr2=0x7fabb0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 0x7fabb0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 -- 172.21.15.155:0/3122251862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009420 con 0x7fabb015d540 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabae59c700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 0x7fabb0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabaed9d700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab9800ea50 tx=0x7fab980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800ee90 con 0x7fabb015d540 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9800c850 con 0x7fabb015d540 2024-08-17T02:28:10.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb00ab530 con 0x7fabb015d540 2024-08-17T02:28:10.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800cc10 con 0x7fabb015d540 2024-08-17T02:28:10.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb00aab90 con 0x7fabb015d540 2024-08-17T02:28:10.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.080+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb016d910 con 0x7fabb015d540 2024-08-17T02:28:10.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.084+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fab98013470 con 0x7fabb015d540 2024-08-17T02:28:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.084+0000 7faba67fc700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 0x7fab90062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.084+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab9807d5d0 con 0x7fabb015d540 2024-08-17T02:28:10.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.084+0000 7fabae59c700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 0x7fab90062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.084+0000 7fabae59c700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 0x7fab90062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faba00093f0 tx=0x7faba0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.088+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fab9804da00 con 0x7fabb015d540 2024-08-17T02:28:10.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.252+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb00645c0 con 0x7fabb015d540 2024-08-17T02:28:10.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.252+0000 7faba67fc700 1 -- 172.21.15.155:0/3122251862 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fab98051020 con 0x7fabb015d540 2024-08-17T02:28:10.257 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:10.258 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":31,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:28:09.299145+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 msgr2=0x7fab90062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 0x7fab90062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faba00093f0 tx=0x7faba0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 msgr2=0x7fabb01633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab9800ea50 tx=0x7fab980091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 shutdown_connections 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fab90060860 0x7fab90062d10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabb015d540 0x7fabb01633d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fabb00a9430 0x7fabb00ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 --2- 172.21.15.155:0/3122251862 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fabb006e830 0x7fabb0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 >> 172.21.15.155:0/3122251862 conn(0x7fabb0066e00 msgr2=0x7fabb015b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 shutdown_connections 2024-08-17T02:28:10.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.256+0000 7fabb4d68700 1 -- 172.21.15.155:0/3122251862 wait complete. 2024-08-17T02:28:10.272 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:10.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 Processor -- start 2024-08-17T02:28:10.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 -- start start 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f3850161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38500cbaa0 con 0x7f38500b14a0 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3850157630 con 0x7f3850154900 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f3854e6e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3850068790 con 0x7f38500cb560 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f38500b14a0 0x7f38500cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35698/0 (socket says 172.21.15.155:35698) 2024-08-17T02:28:10.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384effd700 1 -- 172.21.15.155:0/3793702441 learned_addr learned my addr 172.21.15.155:0/3793702441 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:10.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384ffff700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f3850161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109261740 0 0) 0x7f38500cbaa0 con 0x7f38500b14a0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383c003570 con 0x7f38500b14a0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353898455 0 0) 0x7f383c003570 con 0x7f38500b14a0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 msgr2=0x7f3850161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f3850161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 >> v1:172.21.15.189:6789/0 conn(0x7f3850154900 legacy=0x7f38500b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850157910 con 0x7f38500b14a0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f3838001470 con 0x7f38500b14a0 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 >> v1:172.21.15.155:6789/0 conn(0x7f38500b14a0 legacy=0x7f38500cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f383c003a90 0x7f383c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f383c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f383c004d50 0x7f383c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850068790 con 0x7f383c003a90 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c00ff20 con 0x7f383c004d50 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.372+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0100e0 con 0x7f38500cb560 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f383c003a90 0x7f383c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384effd700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f383c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f383c004d50 0x7f383c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 -- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 msgr2=0x7f383c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f38500cb560 0x7f383c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 -- 172.21.15.155:0/3793702441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f383c003a90 msgr2=0x7f383c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f383c003a90 0x7f383c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 -- 172.21.15.155:0/3793702441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c003570 con 0x7f383c004d50 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f383c003a90 0x7f383c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f383c004d50 0x7f383c0051c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f384800e210 tx=0x7f384800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=221a21953abd9a59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800eac0 con 0x7f383c004d50 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800f040 con 0x7f383c004d50 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384e7fc700 1 -- 172.21.15.155:0/3793702441 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800ee70 con 0x7f383c004d50 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 -- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f383c004d50 msgr2=0x7f383c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3793702441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f383c004d50 0x7f383c0051c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f384800e210 tx=0x7f384800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f384ffff700 1 -- 172.21.15.155:0/3793702441 reap_dead start 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 -- 172.21.15.155:0/3793702441 shutdown_connections 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 -- 172.21.15.155:0/3793702441 >> 172.21.15.155:0/3793702441 conn(0x7f38500678d0 msgr2=0x7f3850067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 -- 172.21.15.155:0/3793702441 shutdown_connections 2024-08-17T02:28:10.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 -- 172.21.15.155:0/3793702441 wait complete. 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.376+0000 7f3854e6e700 1 Processor -- start 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- start start 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 0x7f3850153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 0x7f3850068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850164f10 con 0x7f38501539c0 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850156150 con 0x7f3850155c60 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3850156430 con 0x7f383c004d50 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42800/0 (socket says 172.21.15.155:42800) 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 -- 172.21.15.155:0/3288005993 learned_addr learned my addr 172.21.15.155:0/3288005993 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384ffff700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 0x7f3850068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 0x7f3850153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 -- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 msgr2=0x7f3850153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 0x7f3850153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 -- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 msgr2=0x7f3850068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 0x7f3850068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 -- 172.21.15.155:0/3288005993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850156710 con 0x7f38501539c0 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 0x7f3850153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384ffff700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 0x7f3850068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f384effd700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38380010e0 tx=0x7f3838001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838018030 con 0x7f38501539c0 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800f660 con 0x7f38501539c0 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800fa00 con 0x7f38501539c0 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38501569f0 con 0x7f38501539c0 2024-08-17T02:28:10.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.380+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3850069480 con 0x7f38501539c0 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3850165080 con 0x7f38501539c0 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f383801b070 con 0x7f38501539c0 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f38477fe700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 0x7f3830062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 0x7f3830062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3838019070 con 0x7f38501539c0 2024-08-17T02:28:10.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.384+0000 7f384f7fe700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 0x7f3830062d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3840001050 tx=0x7f3840009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.392+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f383804d040 con 0x7f38501539c0 2024-08-17T02:28:10.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.556+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38500643a0 con 0x7f38501539c0 2024-08-17T02:28:10.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.556+0000 7f38477fe700 1 -- 172.21.15.155:0/3288005993 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f3838050660 con 0x7f38501539c0 2024-08-17T02:28:10.561 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:10.561 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":31,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:28:09.299145+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 msgr2=0x7f3830062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 0x7f3830062d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3840001050 tx=0x7f3840009040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 msgr2=0x7f3850155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38380010e0 tx=0x7f3838001df0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 shutdown_connections 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3830060890 0x7f3830062d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3850155c60 0x7f3850068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38501539c0 0x7f3850155720 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 --2- 172.21.15.155:0/3288005993 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f383c004d50 0x7f3850153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 >> 172.21.15.155:0/3288005993 conn(0x7f38500678d0 msgr2=0x7f385006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 shutdown_connections 2024-08-17T02:28:10.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.560+0000 7f3854e6e700 1 -- 172.21.15.155:0/3288005993 wait complete. 2024-08-17T02:28:10.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:28:10.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 Processor -- start 2024-08-17T02:28:10.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 -- start start 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4159300 0x7f6bc40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6bc4067510 0x7f6bc40cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40cba90 con 0x7f6bc41596d0 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40b2b60 con 0x7f6bc4067510 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bcbfa6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40cb160 con 0x7f6bc4159300 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6bc4067510 0x7f6bc40cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc9541700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6bc41596d0 0x7f6bc4066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35712/0 (socket says 172.21.15.155:35712) 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc9541700 1 -- 172.21.15.155:0/1435852646 learned_addr learned my addr 172.21.15.155:0/1435852646 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc9d42700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4159300 0x7f6bc40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc8d40700 1 -- 172.21.15.155:0/1435852646 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005024863 0 0) 0x7f6bc40cba90 con 0x7f6bc41596d0 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc8d40700 1 -- 172.21.15.155:0/1435852646 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0003570 con 0x7f6bc41596d0 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 -- 172.21.15.155:0/1435852646 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4159300 msgr2=0x7f6bc40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4159300 0x7f6bc40b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 -- 172.21.15.155:0/1435852646 >> v1:172.21.15.155:6789/0 conn(0x7f6bc41596d0 legacy=0x7f6bc4066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 -- 172.21.15.155:0/1435852646 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40cb440 con 0x7f6bc4067510 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bca543700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc4067510 0x7f6bc40cbf20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009e60 tx=0x7f6bbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2f50ff102578c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc8d40700 1 -- 172.21.15.155:0/1435852646 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00e070 con 0x7f6bc4067510 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc8d40700 1 -- 172.21.15.155:0/1435852646 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00bb60 con 0x7f6bc4067510 2024-08-17T02:28:10.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.688+0000 7f6bc8d40700 1 -- 172.21.15.155:0/1435852646 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc012430 con 0x7f6bc4067510 2024-08-17T02:28:10.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1435852646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc4067510 msgr2=0x7f6bc40cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc4067510 0x7f6bc40cbf20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009e60 tx=0x7f6bbc009780 comp rx=0 tx=0).stop 2024-08-17T02:28:10.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1435852646 shutdown_connections 2024-08-17T02:28:10.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc4067510 0x7f6bc40cbf20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1435852646 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4159300 0x7f6bc40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1435852646 >> 172.21.15.155:0/1435852646 conn(0x7f6bc40682c0 msgr2=0x7f6bc40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1435852646 shutdown_connections 2024-08-17T02:28:10.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1435852646 wait complete. 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 Processor -- start 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- start start 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 0x7f6bc4152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4159300 0x7f6bc40c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40c9390 con 0x7f6bc41596d0 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40c8780 con 0x7f6bc4159300 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bcbfa6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40c8a60 con 0x7f6bc4067510 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42816/0 (socket says 172.21.15.155:42816) 2024-08-17T02:28:10.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 -- 172.21.15.155:0/1442656013 learned_addr learned my addr 172.21.15.155:0/1442656013 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:10.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bc9541700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4159300 0x7f6bc40c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bc9d42700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 0x7f6bc4152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 -- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 msgr2=0x7f6bc4152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 0x7f6bc4152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 -- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4159300 msgr2=0x7f6bc40c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4159300 0x7f6bc40c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 -- 172.21.15.155:0/1442656013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009a20 con 0x7f6bc41596d0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bc9d42700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 0x7f6bc4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.692+0000 7f6bca543700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc013000 tx=0x7f6bbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc027470 con 0x7f6bc41596d0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc40c8d40 con 0x7f6bc41596d0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0275f0 con 0x7f6bc41596d0 2024-08-17T02:28:10.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0279b0 con 0x7f6bc41596d0 2024-08-17T02:28:10.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc41527d0 con 0x7f6bc41596d0 2024-08-17T02:28:10.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6bbc024070 con 0x7f6bc41596d0 2024-08-17T02:28:10.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc40c9540 con 0x7f6bc41596d0 2024-08-17T02:28:10.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 0x7f6ba8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bbc07f5f0 con 0x7f6bc41596d0 2024-08-17T02:28:10.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bc9d42700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 0x7f6ba8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.696+0000 7f6bc9d42700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 0x7f6ba8062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006fd0 tx=0x7f6bc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.708+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6bbc04f9a0 con 0x7f6bc41596d0 2024-08-17T02:28:10.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:10.904+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6bc40645c0 con 0x7f6bc41596d0 2024-08-17T02:28:11.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.464+0000 7f6bb9ffb700 1 -- 172.21.15.155:0/1442656013 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6bbc052fc0 con 0x7f6bc41596d0 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 msgr2=0x7f6ba8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 0x7f6ba8062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006fd0 tx=0x7f6bc0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 msgr2=0x7f6bc415ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc013000 tx=0x7f6bbc019000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 shutdown_connections 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ba8060860 0x7f6ba8062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc41596d0 0x7f6bc415ac90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4159300 0x7f6bc40c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 --2- 172.21.15.155:0/1442656013 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6bc4067510 0x7f6bc4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 >> 172.21.15.155:0/1442656013 conn(0x7f6bc40682c0 msgr2=0x7f6bc40b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 shutdown_connections 2024-08-17T02:28:11.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.468+0000 7f6bcbfa6700 1 -- 172.21.15.155:0/1442656013 wait complete. 2024-08-17T02:28:11.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:28:11.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 Processor -- start 2024-08-17T02:28:11.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 -- start start 2024-08-17T02:28:11.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7db40cc840 0x7f7db40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db40cd150 con 0x7f7db40b5040 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40b2b80 con 0x7f7db40cc840 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.604+0000 7f7dba0d3700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40af570 con 0x7f7db40b2210 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7db40cc840 0x7f7db40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7db40b5040 0x7f7db40b54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35722/0 (socket says 172.21.15.155:35722) 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db3fff700 1 -- 172.21.15.155:0/2514757261 learned_addr learned my addr 172.21.15.155:0/2514757261 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:11.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db2ffd700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 -- 172.21.15.155:0/2514757261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 msgr2=0x7f7db40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db40b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db27fc700 1 -- 172.21.15.155:0/2514757261 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637905324 0 0) 0x7f7db40cd150 con 0x7f7db40b5040 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 -- 172.21.15.155:0/2514757261 >> v1:172.21.15.155:6789/0 conn(0x7f7db40b5040 legacy=0x7f7db40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 -- 172.21.15.155:0/2514757261 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4159ce0 con 0x7f7db40cc840 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db2ffd700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db40b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db37fe700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40cc840 0x7f7db40ccc10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0098e0 tx=0x7f7dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82619d9223db937c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db27fc700 1 -- 172.21.15.155:0/2514757261 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00b640 con 0x7f7db40cc840 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db27fc700 1 -- 172.21.15.155:0/2514757261 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00b7a0 con 0x7f7db40cc840 2024-08-17T02:28:11.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7db27fc700 1 -- 172.21.15.155:0/2514757261 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00bb40 con 0x7f7db40cc840 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2514757261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40cc840 msgr2=0x7f7db40ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40cc840 0x7f7db40ccc10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0098e0 tx=0x7f7dac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2514757261 shutdown_connections 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db40b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2514757261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40cc840 0x7f7db40ccc10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2514757261 >> 172.21.15.155:0/2514757261 conn(0x7f7db40682c0 msgr2=0x7f7db40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2514757261 shutdown_connections 2024-08-17T02:28:11.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.608+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2514757261 wait complete. 2024-08-17T02:28:11.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 Processor -- start 2024-08-17T02:28:11.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 -- start start 2024-08-17T02:28:11.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db40cc840 0x7f7db4153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4151d90 con 0x7f7db40b5040 2024-08-17T02:28:11.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40c5eb0 con 0x7f7db40cc840 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7dba0d3700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40c6190 con 0x7f7db40b2210 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42844/0 (socket says 172.21.15.155:42844) 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 -- 172.21.15.155:0/2410009416 learned_addr learned my addr 172.21.15.155:0/2410009416 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db37fe700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db3fff700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db40cc840 0x7f7db4153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 -- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 msgr2=0x7f7db4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db4151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 -- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db40cc840 msgr2=0x7f7db4153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db40cc840 0x7f7db4153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.612+0000 7f7db2ffd700 1 -- 172.21.15.155:0/2410009416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c009420 con 0x7f7db40b5040 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7db2ffd700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ec80 tx=0x7f7d9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00c8f0 con 0x7f7db40b5040 2024-08-17T02:28:11.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c00ca50 con 0x7f7db40b5040 2024-08-17T02:28:11.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac009420 con 0x7f7db40b5040 2024-08-17T02:28:11.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00cdd0 con 0x7f7db40b5040 2024-08-17T02:28:11.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db40c6750 con 0x7f7db40b5040 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db40645c0 con 0x7f7db40b5040 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7d9c013680 con 0x7f7db40b5040 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 0x7f7d94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d9c07cf60 con 0x7f7db40b5040 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.616+0000 7f7db37fe700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 0x7f7d94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.620+0000 7f7db37fe700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 0x7f7d94062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0093f0 tx=0x7f7dac017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.624+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7d9c04d3b0 con 0x7f7db40b5040 2024-08-17T02:28:11.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:11.828+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7db40b1570 con 0x7f7db40b5040 2024-08-17T02:28:12.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.472+0000 7f7dab7fe700 1 -- 172.21.15.155:0/2410009416 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7d9c0170c0 con 0x7f7db40b5040 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 msgr2=0x7f7d94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 0x7f7d94062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0093f0 tx=0x7f7dac017000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 msgr2=0x7f7db4153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ec80 tx=0x7f7d9c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 shutdown_connections 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7d94060860 0x7f7d94062d10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db40cc840 0x7f7db4153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7db40b5040 0x7f7db4153300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 --2- 172.21.15.155:0/2410009416 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7db40b2210 0x7f7db4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 >> 172.21.15.155:0/2410009416 conn(0x7f7db40682c0 msgr2=0x7f7db40b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 shutdown_connections 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.476+0000 7f7dba0d3700 1 -- 172.21.15.155:0/2410009416 wait complete. 2024-08-17T02:28:12.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:12.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 Processor -- start 2024-08-17T02:28:12.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 -- start start 2024-08-17T02:28:12.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca20068c10 0x7fca20158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 0x7fca200ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca200aa270 con 0x7fca20068840 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca20069090 con 0x7fca20068c10 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25841700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca200aa550 con 0x7fca20158fa0 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca20068c10 0x7fca20158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca20068c10 0x7fca20158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42848/0 (socket says 172.21.15.155:42848) 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 -- 172.21.15.155:0/2512090467 learned_addr learned my addr 172.21.15.155:0/2512090467 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:12.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25040700 1 --2- 172.21.15.155:0/2512090467 >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 0x7fca200ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 -- 172.21.15.155:0/2512090467 >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 msgr2=0x7fca200ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 --2- 172.21.15.155:0/2512090467 >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 0x7fca200ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 -- 172.21.15.155:0/2512090467 >> v1:172.21.15.189:6789/0 conn(0x7fca20068840 legacy=0x7fca200a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 -- 172.21.15.155:0/2512090467 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200aa830 con 0x7fca20068c10 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca25040700 1 --2- 172.21.15.155:0/2512090467 >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 0x7fca200ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca17fff700 1 --2- 172.21.15.155:0/2512090467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20068c10 0x7fca20158a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fca100099b0 tx=0x7fca10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49ad2e38eaeba6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca177fe700 1 -- 172.21.15.155:0/2512090467 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000b820 con 0x7fca20068c10 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca177fe700 1 -- 172.21.15.155:0/2512090467 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000b980 con 0x7fca20068c10 2024-08-17T02:28:12.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.604+0000 7fca177fe700 1 -- 172.21.15.155:0/2512090467 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000bd20 con 0x7fca20068c10 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- 172.21.15.155:0/2512090467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20068c10 msgr2=0x7fca20158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- 172.21.15.155:0/2512090467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20068c10 0x7fca20158a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fca100099b0 tx=0x7fca10009250 comp rx=0 tx=0).stop 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- 172.21.15.155:0/2512090467 shutdown_connections 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- 172.21.15.155:0/2512090467 >> v2:172.21.15.189:3300/0 conn(0x7fca20158fa0 0x7fca200ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- 172.21.15.155:0/2512090467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20068c10 0x7fca20158a60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- 172.21.15.155:0/2512090467 >> 172.21.15.155:0/2512090467 conn(0x7fca2006d800 msgr2=0x7fca2006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- 172.21.15.155:0/2512090467 shutdown_connections 2024-08-17T02:28:12.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- 172.21.15.155:0/2512090467 wait complete. 2024-08-17T02:28:12.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 Processor -- start 2024-08-17T02:28:12.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- start start 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca20068840 0x7fca20151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca20068c10 0x7fca20169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca20152100 con 0x7fca20158fa0 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2016a4c0 con 0x7fca20068c10 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25841700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2015a2a0 con 0x7fca20068840 2024-08-17T02:28:12.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25040700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25040700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42864/0 (socket says 172.21.15.155:42864) 2024-08-17T02:28:12.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.608+0000 7fca25040700 1 -- 172.21.15.155:0/883408694 learned_addr learned my addr 172.21.15.155:0/883408694 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:12.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca2483f700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca20068840 0x7fca20151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca17fff700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca20068c10 0x7fca20169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 -- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca20068840 msgr2=0x7fca20151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca20068840 0x7fca20151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 -- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca20068c10 msgr2=0x7fca20169f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca20068c10 0x7fca20169f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 -- 172.21.15.155:0/883408694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100094f0 con 0x7fca20158fa0 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25040700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fc0 tx=0x7fca180099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800dbe0 con 0x7fca20158fa0 2024-08-17T02:28:12.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800f040 con 0x7fca20158fa0 2024-08-17T02:28:12.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2015ecf0 con 0x7fca20158fa0 2024-08-17T02:28:12.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18015440 con 0x7fca20158fa0 2024-08-17T02:28:12.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.612+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca20159970 con 0x7fca20158fa0 2024-08-17T02:28:12.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca200638f0 con 0x7fca20158fa0 2024-08-17T02:28:12.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fca1801e3b0 con 0x7fca20158fa0 2024-08-17T02:28:12.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca14ff9700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 0x7fca0c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca1807d000 con 0x7fca20158fa0 2024-08-17T02:28:12.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca2483f700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 0x7fca0c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.616+0000 7fca2483f700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 0x7fca0c062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca1c003a80 tx=0x7fca1c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.624+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca1804d450 con 0x7fca20158fa0 2024-08-17T02:28:12.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.824+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca2015a3e0 con 0x7fca20158fa0 2024-08-17T02:28:12.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.824+0000 7fca14ff9700 1 -- 172.21.15.155:0/883408694 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fca18050a70 con 0x7fca20158fa0 2024-08-17T02:28:12.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:12.829 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4930,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 msgr2=0x7fca0c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 0x7fca0c062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca1c003a80 tx=0x7fca1c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 msgr2=0x7fca2015e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fc0 tx=0x7fca180099b0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 shutdown_connections 2024-08-17T02:28:12.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca0c060860 0x7fca0c062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca20158fa0 0x7fca2015e7b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca20068c10 0x7fca20169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 --2- 172.21.15.155:0/883408694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca20068840 0x7fca20151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 >> 172.21.15.155:0/883408694 conn(0x7fca2006d800 msgr2=0x7fca20069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 shutdown_connections 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.828+0000 7fca25841700 1 -- 172.21.15.155:0/883408694 wait complete. 2024-08-17T02:28:12.832 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 14 2024-08-17T02:28:12.843 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:12.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 Processor -- start 2024-08-17T02:28:12.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 -- start start 2024-08-17T02:28:12.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 0x7fd7e80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80cf190 con 0x7fd7e80d0010 2024-08-17T02:28:12.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80d09a0 con 0x7fd7e815d5b0 2024-08-17T02:28:12.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ee6ca700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80ce5e0 con 0x7fd7e8159040 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7edec9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 0x7fd7e80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:41734/0 (socket says 172.21.15.155:41734) 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7edec9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 0x7fd7e80d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42872/0 (socket says 172.21.15.155:42872) 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 -- 172.21.15.155:0/2470108731 learned_addr learned my addr 172.21.15.155:0/2470108731 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 -- 172.21.15.155:0/2470108731 >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 msgr2=0x7fd7e80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/2470108731 >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 0x7fd7e80d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 -- 172.21.15.155:0/2470108731 >> v1:172.21.15.189:6789/0 conn(0x7fd7e80d0010 legacy=0x7fd7e815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 -- 172.21.15.155:0/2470108731 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80ce860 con 0x7fd7e8159040 2024-08-17T02:28:12.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/2470108731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009f20 tx=0x7fd7d0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29fe7105578aea0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7e7fff700 1 -- 172.21.15.155:0/2470108731 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000e070 con 0x7fd7e8159040 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7e7fff700 1 -- 172.21.15.155:0/2470108731 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000b9d0 con 0x7fd7e8159040 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.944+0000 7fd7e7fff700 1 -- 172.21.15.155:0/2470108731 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00092e0 con 0x7fd7e8159040 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/2470108731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 msgr2=0x7fd7e80cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/2470108731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009f20 tx=0x7fd7d0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/2470108731 shutdown_connections 2024-08-17T02:28:12.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/2470108731 >> v2:172.21.15.155:3300/0 conn(0x7fd7e815d5b0 0x7fd7e80d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/2470108731 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e8159040 0x7fd7e80cf620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/2470108731 >> 172.21.15.155:0/2470108731 conn(0x7fd7e8068250 msgr2=0x7fd7e8068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/2470108731 shutdown_connections 2024-08-17T02:28:12.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/2470108731 wait complete. 2024-08-17T02:28:12.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 Processor -- start 2024-08-17T02:28:12.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- start start 2024-08-17T02:28:12.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 0x7fd7e814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 0x7fd7e815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e814c840 con 0x7fd7e8159040 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e815b250 con 0x7fd7e815d5b0 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e814bf10 con 0x7fd7e80d0010 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42884/0 (socket says 172.21.15.155:42884) 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 -- 172.21.15.155:0/1120123978 learned_addr learned my addr 172.21.15.155:0/1120123978 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:12.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 0x7fd7e814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7edec9700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 0x7fd7e815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 -- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 msgr2=0x7fd7e814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 0x7fd7e814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 -- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 msgr2=0x7fd7e815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 0x7fd7e815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 -- 172.21.15.155:0/1120123978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0009ae0 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7edec9700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 0x7fd7e815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 0x7fd7e814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ecec7700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c590 tx=0x7fd7d800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011590 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80116f0 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e814c1f0 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011ab0 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.948+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e814d210 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e814c9b0 con 0x7fd7e8159040 2024-08-17T02:28:12.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd7d801b3b0 con 0x7fd7e8159040 2024-08-17T02:28:12.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7e57fa700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 0x7fd7c8062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 0x7fd7c8062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7d807c1f0 con 0x7fd7e8159040 2024-08-17T02:28:12.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.952+0000 7fd7ed6c8700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 0x7fd7c8062d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009880 tx=0x7fd7d0018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:12.960+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd7d804c5a0 con 0x7fd7e8159040 2024-08-17T02:28:13.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.124+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7e80643a0 con 0x7fd7e8159040 2024-08-17T02:28:13.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.124+0000 7fd7e57fa700 1 -- 172.21.15.155:0/1120123978 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd7d804fbc0 con 0x7fd7e8159040 2024-08-17T02:28:13.128 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:13.128 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":32,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:28:10.937949+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:13.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 msgr2=0x7fd7c8062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 0x7fd7c8062d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009880 tx=0x7fd7d0018000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 msgr2=0x7fd7e815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c590 tx=0x7fd7d800c950 comp rx=0 tx=0).stop 2024-08-17T02:28:13.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 shutdown_connections 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd7c80608e0 0x7fd7c8062d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e815d5b0 0x7fd7e815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e8159040 0x7fd7e815a7d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 --2- 172.21.15.155:0/1120123978 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7e80d0010 0x7fd7e814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 >> 172.21.15.155:0/1120123978 conn(0x7fd7e8068250 msgr2=0x7fd7e81535d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 shutdown_connections 2024-08-17T02:28:13.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.128+0000 7fd7ee6ca700 1 -- 172.21.15.155:0/1120123978 wait complete. 2024-08-17T02:28:13.147 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:28:13.148 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:13.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 Processor -- start 2024-08-17T02:28:13.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 -- start start 2024-08-17T02:28:13.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc6c015d540 0x7fc6c00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 0x7fc6c00a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00b0270 con 0x7fc6c00a9260 2024-08-17T02:28:13.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00af660 con 0x7fc6c015d540 2024-08-17T02:28:13.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00af940 con 0x7fc6c006e830 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bed9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc6c00a9260 0x7fc6c00b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35728/0 (socket says 172.21.15.155:35728) 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bed9d700 1 -- 172.21.15.155:0/47281537 learned_addr learned my addr 172.21.15.155:0/47281537 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/47281537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 0x7fc6c00a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6be59c700 1 --2- 172.21.15.155:0/47281537 >> v2:172.21.15.189:3300/0 conn(0x7fc6c015d540 0x7fc6c00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bd59a700 1 -- 172.21.15.155:0/47281537 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776653321 0 0) 0x7fc6c00b0270 con 0x7fc6c00a9260 2024-08-17T02:28:13.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bd59a700 1 -- 172.21.15.155:0/47281537 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a8003570 con 0x7fc6c00a9260 2024-08-17T02:28:13.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/47281537 >> v2:172.21.15.189:3300/0 conn(0x7fc6c015d540 msgr2=0x7fc6c00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/47281537 >> v2:172.21.15.189:3300/0 conn(0x7fc6c015d540 0x7fc6c00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/47281537 >> v1:172.21.15.155:6789/0 conn(0x7fc6c00a9260 legacy=0x7fc6c00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/47281537 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00afc20 con 0x7fc6c006e830 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/47281537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 0x7fc6c00a8d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009e60 tx=0x7fc6b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c85b7d9ebf0417 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bd59a700 1 -- 172.21.15.155:0/47281537 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e070 con 0x7fc6c006e830 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bd59a700 1 -- 172.21.15.155:0/47281537 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000bab0 con 0x7fc6c006e830 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6bd59a700 1 -- 172.21.15.155:0/47281537 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000be30 con 0x7fc6c006e830 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 -- 172.21.15.155:0/47281537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 msgr2=0x7fc6c00a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.256+0000 7fc6c4813700 1 --2- 172.21.15.155:0/47281537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 0x7fc6c00a8d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009e60 tx=0x7fc6b0009780 comp rx=0 tx=0).stop 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- 172.21.15.155:0/47281537 shutdown_connections 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 --2- 172.21.15.155:0/47281537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c006e830 0x7fc6c00a8d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 --2- 172.21.15.155:0/47281537 >> v2:172.21.15.189:3300/0 conn(0x7fc6c015d540 0x7fc6c00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- 172.21.15.155:0/47281537 >> 172.21.15.155:0/47281537 conn(0x7fc6c0066e00 msgr2=0x7fc6c0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- 172.21.15.155:0/47281537 shutdown_connections 2024-08-17T02:28:13.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- 172.21.15.155:0/47281537 wait complete. 2024-08-17T02:28:13.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 Processor -- start 2024-08-17T02:28:13.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- start start 2024-08-17T02:28:13.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 0x7fc6c015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 0x7fc6c015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01608d0 con 0x7fc6c00a9260 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0099e30 con 0x7fc6c006e830 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6c4813700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c015e860 con 0x7fc6c015d540 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42894/0 (socket says 172.21.15.155:42894) 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/1399059482 learned_addr learned my addr 172.21.15.155:0/1399059482 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bed9d700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 0x7fc6c015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6be59c700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 0x7fc6c015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 msgr2=0x7fc6c015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 0x7fc6c015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 msgr2=0x7fc6c015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 0x7fc6c015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 -- 172.21.15.155:0/1399059482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009a20 con 0x7fc6c00a9260 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bed9d700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 0x7fc6c015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6be59c700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 0x7fc6c015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.260+0000 7fc6bdd9b700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6c006f870 tx=0x7fc6b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0012ab0 con 0x7fc6c00a9260 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c015f830 con 0x7fc6c00a9260 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0021070 con 0x7fc6c00a9260 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c01600d0 con 0x7fc6c00a9260 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0012e40 con 0x7fc6c00a9260 2024-08-17T02:28:13.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c00645c0 con 0x7fc6c00a9260 2024-08-17T02:28:13.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc6b0023030 con 0x7fc6c00a9260 2024-08-17T02:28:13.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 0x7fc6a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6b007e980 con 0x7fc6c00a9260 2024-08-17T02:28:13.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6be59c700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 0x7fc6a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.264+0000 7fc6be59c700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 0x7fc6a0062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006f00 tx=0x7fc6b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.272+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc6b004edd0 con 0x7fc6c00a9260 2024-08-17T02:28:13.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.432+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6c015fc80 con 0x7fc6a0060860 2024-08-17T02:28:13.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.448+0000 7fc6ae7fc700 1 -- 172.21.15.155:0/1399059482 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264538 (secure 0 0 0) 0x7fc6c015fc80 con 0x7fc6a0060860 2024-08-17T02:28:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:13.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 msgr2=0x7fc6a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 0x7fc6a0062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006f00 tx=0x7fc6b4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:13.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 msgr2=0x7fc6c01590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6c006f870 tx=0x7fc6b0019000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 shutdown_connections 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc6a0060860 0x7fc6a0062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c015d540 0x7fc6c015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c00a9260 0x7fc6c01590b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 --2- 172.21.15.155:0/1399059482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c006e830 0x7fc6c015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 >> 172.21.15.155:0/1399059482 conn(0x7fc6c0066e00 msgr2=0x7fc6c0067fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 shutdown_connections 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.452+0000 7fc6c4813700 1 -- 172.21.15.155:0/1399059482 wait complete. 2024-08-17T02:28:13.459 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:28:13.471 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-08-17T02:28:11.952967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391120,"kb_used_data":3908,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583600,"statfs":{"total":773094113280,"available":770645606400,"internally_reserved":0,"allocated":4001792,"data_stored":2228953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026527"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962728+0000","last_change":"2024-08-17T02:28:09.962728+0000","last_active":"2024-08-17T02:28:09.962728+0000","last_peered":"2024-08-17T02:28:09.962728+0000","last_clean":"2024-08-17T02:28:09.962728+0000","last_became_active":"2024-08-17T02:28:09.961974+0000","last_became_peered":"2024-08-17T02:28:09.961974+0000","last_unstale":"2024-08-17T02:28:09.962728+0000","last_undegraded":"2024-08-17T02:28:09.962728+0000","last_fullsized":"2024-08-17T02:28:09.962728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:36.354574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967800+0000","last_change":"2024-08-17T02:28:09.967800+0000","last_active":"2024-08-17T02:28:09.967800+0000","last_peered":"2024-08-17T02:28:09.967800+0000","last_clean":"2024-08-17T02:28:09.967800+0000","last_became_active":"2024-08-17T02:28:09.967384+0000","last_became_peered":"2024-08-17T02:28:09.967384+0000","last_unstale":"2024-08-17T02:28:09.967800+0000","last_undegraded":"2024-08-17T02:28:09.967800+0000","last_fullsized":"2024-08-17T02:28:09.967800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966553+0000","last_change":"2024-08-17T02:28:09.961569+0000","last_active":"2024-08-17T02:28:09.966553+0000","last_peered":"2024-08-17T02:28:09.966553+0000","last_clean":"2024-08-17T02:28:09.966553+0000","last_became_active":"2024-08-17T02:28:09.961276+0000","last_became_peered":"2024-08-17T02:28:09.961276+0000","last_unstale":"2024-08-17T02:28:09.966553+0000","last_undegraded":"2024-08-17T02:28:09.966553+0000","last_fullsized":"2024-08-17T02:28:09.966553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:26.171844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963105+0000","last_change":"2024-08-17T02:28:09.963105+0000","last_active":"2024-08-17T02:28:09.963105+0000","last_peered":"2024-08-17T02:28:09.963105+0000","last_clean":"2024-08-17T02:28:09.963105+0000","last_became_active":"2024-08-17T02:28:09.962618+0000","last_became_peered":"2024-08-17T02:28:09.962618+0000","last_unstale":"2024-08-17T02:28:09.963105+0000","last_undegraded":"2024-08-17T02:28:09.963105+0000","last_fullsized":"2024-08-17T02:28:09.963105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966725+0000","last_change":"2024-08-17T02:28:09.966725+0000","last_active":"2024-08-17T02:28:09.966725+0000","last_peered":"2024-08-17T02:28:09.966725+0000","last_clean":"2024-08-17T02:28:09.966725+0000","last_became_active":"2024-08-17T02:28:09.966455+0000","last_became_peered":"2024-08-17T02:28:09.966455+0000","last_unstale":"2024-08-17T02:28:09.966725+0000","last_undegraded":"2024-08-17T02:28:09.966725+0000","last_fullsized":"2024-08-17T02:28:09.966725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959600+0000","last_change":"2024-08-17T02:28:09.954287+0000","last_active":"2024-08-17T02:28:09.959600+0000","last_peered":"2024-08-17T02:28:09.959600+0000","last_clean":"2024-08-17T02:28:09.959600+0000","last_became_active":"2024-08-17T02:28:09.951978+0000","last_became_peered":"2024-08-17T02:28:09.951978+0000","last_unstale":"2024-08-17T02:28:09.959600+0000","last_undegraded":"2024-08-17T02:28:09.959600+0000","last_fullsized":"2024-08-17T02:28:09.959600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:47.651804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.961032+0000","last_change":"2024-08-17T02:28:09.961032+0000","last_active":"2024-08-17T02:28:09.961032+0000","last_peered":"2024-08-17T02:28:09.961032+0000","last_clean":"2024-08-17T02:28:09.961032+0000","last_became_active":"2024-08-17T02:28:09.958590+0000","last_became_peered":"2024-08-17T02:28:09.958590+0000","last_unstale":"2024-08-17T02:28:09.961032+0000","last_undegraded":"2024-08-17T02:28:09.961032+0000","last_fullsized":"2024-08-17T02:28:09.961032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967537+0000","last_change":"2024-08-17T02:28:09.967537+0000","last_active":"2024-08-17T02:28:09.967537+0000","last_peered":"2024-08-17T02:28:09.967537+0000","last_clean":"2024-08-17T02:28:09.967537+0000","last_became_active":"2024-08-17T02:28:09.967302+0000","last_became_peered":"2024-08-17T02:28:09.967302+0000","last_unstale":"2024-08-17T02:28:09.967537+0000","last_undegraded":"2024-08-17T02:28:09.967537+0000","last_fullsized":"2024-08-17T02:28:09.967537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:32.358321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968803+0000","last_change":"2024-08-17T02:28:09.963107+0000","last_active":"2024-08-17T02:28:09.968803+0000","last_peered":"2024-08-17T02:28:09.968803+0000","last_clean":"2024-08-17T02:28:09.968803+0000","last_became_active":"2024-08-17T02:28:09.962823+0000","last_became_peered":"2024-08-17T02:28:09.962823+0000","last_unstale":"2024-08-17T02:28:09.968803+0000","last_undegraded":"2024-08-17T02:28:09.968803+0000","last_fullsized":"2024-08-17T02:28:09.968803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:45.530464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.969835+0000","last_change":"2024-08-17T02:28:09.969835+0000","last_active":"2024-08-17T02:28:09.969835+0000","last_peered":"2024-08-17T02:28:09.969835+0000","last_clean":"2024-08-17T02:28:09.969835+0000","last_became_active":"2024-08-17T02:28:09.969480+0000","last_became_peered":"2024-08-17T02:28:09.969480+0000","last_unstale":"2024-08-17T02:28:09.969835+0000","last_undegraded":"2024-08-17T02:28:09.969835+0000","last_fullsized":"2024-08-17T02:28:09.969835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:02.200591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972630+0000","last_change":"2024-08-17T02:28:09.968536+0000","last_active":"2024-08-17T02:28:09.972630+0000","last_peered":"2024-08-17T02:28:09.972630+0000","last_clean":"2024-08-17T02:28:09.972630+0000","last_became_active":"2024-08-17T02:28:09.967877+0000","last_became_peered":"2024-08-17T02:28:09.967877+0000","last_unstale":"2024-08-17T02:28:09.972630+0000","last_undegraded":"2024-08-17T02:28:09.972630+0000","last_fullsized":"2024-08-17T02:28:09.972630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:33.116610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968893+0000","last_change":"2024-08-17T02:28:09.966942+0000","last_active":"2024-08-17T02:28:09.968893+0000","last_peered":"2024-08-17T02:28:09.968893+0000","last_clean":"2024-08-17T02:28:09.968893+0000","last_became_active":"2024-08-17T02:28:09.966009+0000","last_became_peered":"2024-08-17T02:28:09.966009+0000","last_unstale":"2024-08-17T02:28:09.968893+0000","last_undegraded":"2024-08-17T02:28:09.968893+0000","last_fullsized":"2024-08-17T02:28:09.968893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:34.183511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964451+0000","last_change":"2024-08-17T02:28:09.964451+0000","last_active":"2024-08-17T02:28:09.964451+0000","last_peered":"2024-08-17T02:28:09.964451+0000","last_clean":"2024-08-17T02:28:09.964451+0000","last_became_active":"2024-08-17T02:28:09.963936+0000","last_became_peered":"2024-08-17T02:28:09.963936+0000","last_unstale":"2024-08-17T02:28:09.964451+0000","last_undegraded":"2024-08-17T02:28:09.964451+0000","last_fullsized":"2024-08-17T02:28:09.964451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:19.290734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972072+0000","last_change":"2024-08-17T02:28:09.972072+0000","last_active":"2024-08-17T02:28:09.972072+0000","last_peered":"2024-08-17T02:28:09.972072+0000","last_clean":"2024-08-17T02:28:09.972072+0000","last_became_active":"2024-08-17T02:28:09.971786+0000","last_became_peered":"2024-08-17T02:28:09.971786+0000","last_unstale":"2024-08-17T02:28:09.972072+0000","last_undegraded":"2024-08-17T02:28:09.972072+0000","last_fullsized":"2024-08-17T02:28:09.972072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966210+0000","last_change":"2024-08-17T02:28:09.966210+0000","last_active":"2024-08-17T02:28:09.966210+0000","last_peered":"2024-08-17T02:28:09.966210+0000","last_clean":"2024-08-17T02:28:09.966210+0000","last_became_active":"2024-08-17T02:28:09.965950+0000","last_became_peered":"2024-08-17T02:28:09.965950+0000","last_unstale":"2024-08-17T02:28:09.966210+0000","last_undegraded":"2024-08-17T02:28:09.966210+0000","last_fullsized":"2024-08-17T02:28:09.966210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:07.448201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965395+0000","last_change":"2024-08-17T02:28:09.965395+0000","last_active":"2024-08-17T02:28:09.965395+0000","last_peered":"2024-08-17T02:28:09.965395+0000","last_clean":"2024-08-17T02:28:09.965395+0000","last_became_active":"2024-08-17T02:28:09.965069+0000","last_became_peered":"2024-08-17T02:28:09.965069+0000","last_unstale":"2024-08-17T02:28:09.965395+0000","last_undegraded":"2024-08-17T02:28:09.965395+0000","last_fullsized":"2024-08-17T02:28:09.965395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:38.530842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970990+0000","last_change":"2024-08-17T02:28:09.963410+0000","last_active":"2024-08-17T02:28:09.970990+0000","last_peered":"2024-08-17T02:28:09.970990+0000","last_clean":"2024-08-17T02:28:09.970990+0000","last_became_active":"2024-08-17T02:28:09.963143+0000","last_became_peered":"2024-08-17T02:28:09.963143+0000","last_unstale":"2024-08-17T02:28:09.970990+0000","last_undegraded":"2024-08-17T02:28:09.970990+0000","last_fullsized":"2024-08-17T02:28:09.970990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:06:28.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967687+0000","last_change":"2024-08-17T02:28:09.966376+0000","last_active":"2024-08-17T02:28:09.967687+0000","last_peered":"2024-08-17T02:28:09.967687+0000","last_clean":"2024-08-17T02:28:09.967687+0000","last_became_active":"2024-08-17T02:28:09.966081+0000","last_became_peered":"2024-08-17T02:28:09.966081+0000","last_unstale":"2024-08-17T02:28:09.967687+0000","last_undegraded":"2024-08-17T02:28:09.967687+0000","last_fullsized":"2024-08-17T02:28:09.967687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:01.981247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964165+0000","last_change":"2024-08-17T02:28:09.959901+0000","last_active":"2024-08-17T02:28:09.964165+0000","last_peered":"2024-08-17T02:28:09.964165+0000","last_clean":"2024-08-17T02:28:09.964165+0000","last_became_active":"2024-08-17T02:28:09.959321+0000","last_became_peered":"2024-08-17T02:28:09.959321+0000","last_unstale":"2024-08-17T02:28:09.964165+0000","last_undegraded":"2024-08-17T02:28:09.964165+0000","last_fullsized":"2024-08-17T02:28:09.964165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:11:15.213225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965555+0000","last_change":"2024-08-17T02:28:09.965555+0000","last_active":"2024-08-17T02:28:09.965555+0000","last_peered":"2024-08-17T02:28:09.965555+0000","last_clean":"2024-08-17T02:28:09.965555+0000","last_became_active":"2024-08-17T02:28:09.965262+0000","last_became_peered":"2024-08-17T02:28:09.965262+0000","last_unstale":"2024-08-17T02:28:09.965555+0000","last_undegraded":"2024-08-17T02:28:09.965555+0000","last_fullsized":"2024-08-17T02:28:09.965555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:44.502297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967087+0000","last_change":"2024-08-17T02:28:09.967087+0000","last_active":"2024-08-17T02:28:09.967087+0000","last_peered":"2024-08-17T02:28:09.967087+0000","last_clean":"2024-08-17T02:28:09.967087+0000","last_became_active":"2024-08-17T02:28:09.966814+0000","last_became_peered":"2024-08-17T02:28:09.966814+0000","last_unstale":"2024-08-17T02:28:09.967087+0000","last_undegraded":"2024-08-17T02:28:09.967087+0000","last_fullsized":"2024-08-17T02:28:09.967087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:43.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.961751+0000","last_change":"2024-08-17T02:28:09.961751+0000","last_active":"2024-08-17T02:28:09.961751+0000","last_peered":"2024-08-17T02:28:09.961751+0000","last_clean":"2024-08-17T02:28:09.961751+0000","last_became_active":"2024-08-17T02:28:09.961514+0000","last_became_peered":"2024-08-17T02:28:09.961514+0000","last_unstale":"2024-08-17T02:28:09.961751+0000","last_undegraded":"2024-08-17T02:28:09.961751+0000","last_fullsized":"2024-08-17T02:28:09.961751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959428+0000","last_change":"2024-08-17T02:28:09.959428+0000","last_active":"2024-08-17T02:28:09.959428+0000","last_peered":"2024-08-17T02:28:09.959428+0000","last_clean":"2024-08-17T02:28:09.959428+0000","last_became_active":"2024-08-17T02:28:09.958953+0000","last_became_peered":"2024-08-17T02:28:09.958953+0000","last_unstale":"2024-08-17T02:28:09.959428+0000","last_undegraded":"2024-08-17T02:28:09.959428+0000","last_fullsized":"2024-08-17T02:28:09.959428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:24.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959343+0000","last_change":"2024-08-17T02:28:09.959343+0000","last_active":"2024-08-17T02:28:09.959343+0000","last_peered":"2024-08-17T02:28:09.959343+0000","last_clean":"2024-08-17T02:28:09.959343+0000","last_became_active":"2024-08-17T02:28:09.958674+0000","last_became_peered":"2024-08-17T02:28:09.958674+0000","last_unstale":"2024-08-17T02:28:09.959343+0000","last_undegraded":"2024-08-17T02:28:09.959343+0000","last_fullsized":"2024-08-17T02:28:09.959343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:02.200591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971724+0000","last_change":"2024-08-17T02:28:09.971724+0000","last_active":"2024-08-17T02:28:09.971724+0000","last_peered":"2024-08-17T02:28:09.971724+0000","last_clean":"2024-08-17T02:28:09.971724+0000","last_became_active":"2024-08-17T02:28:09.971443+0000","last_became_peered":"2024-08-17T02:28:09.971443+0000","last_unstale":"2024-08-17T02:28:09.971724+0000","last_undegraded":"2024-08-17T02:28:09.971724+0000","last_fullsized":"2024-08-17T02:28:09.971724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:32.358321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962205+0000","last_change":"2024-08-17T02:28:09.962205+0000","last_active":"2024-08-17T02:28:09.962205+0000","last_peered":"2024-08-17T02:28:09.962205+0000","last_clean":"2024-08-17T02:28:09.962205+0000","last_became_active":"2024-08-17T02:28:09.961926+0000","last_became_peered":"2024-08-17T02:28:09.961926+0000","last_unstale":"2024-08-17T02:28:09.962205+0000","last_undegraded":"2024-08-17T02:28:09.962205+0000","last_fullsized":"2024-08-17T02:28:09.962205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:09.369356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964879+0000","last_change":"2024-08-17T02:28:09.964879+0000","last_active":"2024-08-17T02:28:09.964879+0000","last_peered":"2024-08-17T02:28:09.964879+0000","last_clean":"2024-08-17T02:28:09.964879+0000","last_became_active":"2024-08-17T02:28:09.962231+0000","last_became_peered":"2024-08-17T02:28:09.962231+0000","last_unstale":"2024-08-17T02:28:09.964879+0000","last_undegraded":"2024-08-17T02:28:09.964879+0000","last_fullsized":"2024-08-17T02:28:09.964879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966339+0000","last_change":"2024-08-17T02:28:09.966339+0000","last_active":"2024-08-17T02:28:09.966339+0000","last_peered":"2024-08-17T02:28:09.966339+0000","last_clean":"2024-08-17T02:28:09.966339+0000","last_became_active":"2024-08-17T02:28:09.966068+0000","last_became_peered":"2024-08-17T02:28:09.966068+0000","last_unstale":"2024-08-17T02:28:09.966339+0000","last_undegraded":"2024-08-17T02:28:09.966339+0000","last_fullsized":"2024-08-17T02:28:09.966339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:34.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965825+0000","last_change":"2024-08-17T02:28:09.965825+0000","last_active":"2024-08-17T02:28:09.965825+0000","last_peered":"2024-08-17T02:28:09.965825+0000","last_clean":"2024-08-17T02:28:09.965825+0000","last_became_active":"2024-08-17T02:28:09.965549+0000","last_became_peered":"2024-08-17T02:28:09.965549+0000","last_unstale":"2024-08-17T02:28:09.965825+0000","last_undegraded":"2024-08-17T02:28:09.965825+0000","last_fullsized":"2024-08-17T02:28:09.965825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:28.828696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967493+0000","last_change":"2024-08-17T02:28:09.967493+0000","last_active":"2024-08-17T02:28:09.967493+0000","last_peered":"2024-08-17T02:28:09.967493+0000","last_clean":"2024-08-17T02:28:09.967493+0000","last_became_active":"2024-08-17T02:28:09.967204+0000","last_became_peered":"2024-08-17T02:28:09.967204+0000","last_unstale":"2024-08-17T02:28:09.967493+0000","last_undegraded":"2024-08-17T02:28:09.967493+0000","last_fullsized":"2024-08-17T02:28:09.967493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:15.931938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.958260+0000","last_change":"2024-08-17T02:28:09.958260+0000","last_active":"2024-08-17T02:28:09.958260+0000","last_peered":"2024-08-17T02:28:09.958260+0000","last_clean":"2024-08-17T02:28:09.958260+0000","last_became_active":"2024-08-17T02:28:09.957902+0000","last_became_peered":"2024-08-17T02:28:09.957902+0000","last_unstale":"2024-08-17T02:28:09.958260+0000","last_undegraded":"2024-08-17T02:28:09.958260+0000","last_fullsized":"2024-08-17T02:28:09.958260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970526+0000","last_change":"2024-08-17T02:28:09.961933+0000","last_active":"2024-08-17T02:28:09.970526+0000","last_peered":"2024-08-17T02:28:09.970526+0000","last_clean":"2024-08-17T02:28:09.970526+0000","last_became_active":"2024-08-17T02:28:09.961646+0000","last_became_peered":"2024-08-17T02:28:09.961646+0000","last_unstale":"2024-08-17T02:28:09.970526+0000","last_undegraded":"2024-08-17T02:28:09.970526+0000","last_fullsized":"2024-08-17T02:28:09.970526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:15.479646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965265+0000","last_change":"2024-08-17T02:28:09.965265+0000","last_active":"2024-08-17T02:28:09.965265+0000","last_peered":"2024-08-17T02:28:09.965265+0000","last_clean":"2024-08-17T02:28:09.965265+0000","last_became_active":"2024-08-17T02:28:09.964908+0000","last_became_peered":"2024-08-17T02:28:09.964908+0000","last_unstale":"2024-08-17T02:28:09.965265+0000","last_undegraded":"2024-08-17T02:28:09.965265+0000","last_fullsized":"2024-08-17T02:28:09.965265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:16.656067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971287+0000","last_change":"2024-08-17T02:28:08.961034+0000","last_active":"2024-08-17T02:28:09.971287+0000","last_peered":"2024-08-17T02:28:09.971287+0000","last_clean":"2024-08-17T02:28:09.971287+0000","last_became_active":"2024-08-17T02:28:08.960743+0000","last_became_peered":"2024-08-17T02:28:08.960743+0000","last_unstale":"2024-08-17T02:28:09.971287+0000","last_undegraded":"2024-08-17T02:28:09.971287+0000","last_fullsized":"2024-08-17T02:28:09.971287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:35.350563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966178+0000","last_change":"2024-08-17T02:28:09.966178+0000","last_active":"2024-08-17T02:28:09.966178+0000","last_peered":"2024-08-17T02:28:09.966178+0000","last_clean":"2024-08-17T02:28:09.966178+0000","last_became_active":"2024-08-17T02:28:09.965933+0000","last_became_peered":"2024-08-17T02:28:09.965933+0000","last_unstale":"2024-08-17T02:28:09.966178+0000","last_undegraded":"2024-08-17T02:28:09.966178+0000","last_fullsized":"2024-08-17T02:28:09.966178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.954263+0000","last_change":"2024-08-17T02:28:08.956421+0000","last_active":"2024-08-17T02:28:09.954263+0000","last_peered":"2024-08-17T02:28:09.954263+0000","last_clean":"2024-08-17T02:28:09.954263+0000","last_became_active":"2024-08-17T02:28:08.956081+0000","last_became_peered":"2024-08-17T02:28:08.956081+0000","last_unstale":"2024-08-17T02:28:09.954263+0000","last_undegraded":"2024-08-17T02:28:09.954263+0000","last_fullsized":"2024-08-17T02:28:09.954263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:46.647793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.969966+0000","last_change":"2024-08-17T02:28:09.969966+0000","last_active":"2024-08-17T02:28:09.969966+0000","last_peered":"2024-08-17T02:28:09.969966+0000","last_clean":"2024-08-17T02:28:09.969966+0000","last_became_active":"2024-08-17T02:28:09.969519+0000","last_became_peered":"2024-08-17T02:28:09.969519+0000","last_unstale":"2024-08-17T02:28:09.969966+0000","last_undegraded":"2024-08-17T02:28:09.969966+0000","last_fullsized":"2024-08-17T02:28:09.969966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970055+0000","last_change":"2024-08-17T02:28:08.958635+0000","last_active":"2024-08-17T02:28:09.970055+0000","last_peered":"2024-08-17T02:28:09.970055+0000","last_clean":"2024-08-17T02:28:09.970055+0000","last_became_active":"2024-08-17T02:28:08.958336+0000","last_became_peered":"2024-08-17T02:28:08.958336+0000","last_unstale":"2024-08-17T02:28:09.970055+0000","last_undegraded":"2024-08-17T02:28:09.970055+0000","last_fullsized":"2024-08-17T02:28:09.970055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:30.427727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966017+0000","last_change":"2024-08-17T02:28:09.966017+0000","last_active":"2024-08-17T02:28:09.966017+0000","last_peered":"2024-08-17T02:28:09.966017+0000","last_clean":"2024-08-17T02:28:09.966017+0000","last_became_active":"2024-08-17T02:28:09.965718+0000","last_became_peered":"2024-08-17T02:28:09.965718+0000","last_unstale":"2024-08-17T02:28:09.966017+0000","last_undegraded":"2024-08-17T02:28:09.966017+0000","last_fullsized":"2024-08-17T02:28:09.966017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:34.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970080+0000","last_change":"2024-08-17T02:28:08.963481+0000","last_active":"2024-08-17T02:28:09.970080+0000","last_peered":"2024-08-17T02:28:09.970080+0000","last_clean":"2024-08-17T02:28:09.970080+0000","last_became_active":"2024-08-17T02:28:08.962946+0000","last_became_peered":"2024-08-17T02:28:08.962946+0000","last_unstale":"2024-08-17T02:28:09.970080+0000","last_undegraded":"2024-08-17T02:28:09.970080+0000","last_fullsized":"2024-08-17T02:28:09.970080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:01.615127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968813+0000","last_change":"2024-08-17T02:28:09.964329+0000","last_active":"2024-08-17T02:28:09.968813+0000","last_peered":"2024-08-17T02:28:09.968813+0000","last_clean":"2024-08-17T02:28:09.968813+0000","last_became_active":"2024-08-17T02:28:09.964071+0000","last_became_peered":"2024-08-17T02:28:09.964071+0000","last_unstale":"2024-08-17T02:28:09.968813+0000","last_undegraded":"2024-08-17T02:28:09.968813+0000","last_fullsized":"2024-08-17T02:28:09.968813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:16.787053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.945402+0000","last_change":"2024-08-17T02:28:08.964014+0000","last_active":"2024-08-17T02:28:09.945402+0000","last_peered":"2024-08-17T02:28:09.945402+0000","last_clean":"2024-08-17T02:28:09.945402+0000","last_became_active":"2024-08-17T02:28:08.963331+0000","last_became_peered":"2024-08-17T02:28:08.963331+0000","last_unstale":"2024-08-17T02:28:09.945402+0000","last_undegraded":"2024-08-17T02:28:09.945402+0000","last_fullsized":"2024-08-17T02:28:09.945402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:46.647793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.957520+0000","last_change":"2024-08-17T02:28:09.957520+0000","last_active":"2024-08-17T02:28:09.957520+0000","last_peered":"2024-08-17T02:28:09.957520+0000","last_clean":"2024-08-17T02:28:09.957520+0000","last_became_active":"2024-08-17T02:28:09.956760+0000","last_became_peered":"2024-08-17T02:28:09.956760+0000","last_unstale":"2024-08-17T02:28:09.957520+0000","last_undegraded":"2024-08-17T02:28:09.957520+0000","last_fullsized":"2024-08-17T02:28:09.957520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:52.813679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.943761+0000","last_change":"2024-08-17T02:28:08.964239+0000","last_active":"2024-08-17T02:28:09.943761+0000","last_peered":"2024-08-17T02:28:09.943761+0000","last_clean":"2024-08-17T02:28:09.943761+0000","last_became_active":"2024-08-17T02:28:08.963868+0000","last_became_peered":"2024-08-17T02:28:08.963868+0000","last_unstale":"2024-08-17T02:28:09.943761+0000","last_undegraded":"2024-08-17T02:28:09.943761+0000","last_fullsized":"2024-08-17T02:28:09.943761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:01.615127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959538+0000","last_change":"2024-08-17T02:28:09.958951+0000","last_active":"2024-08-17T02:28:09.959538+0000","last_peered":"2024-08-17T02:28:09.959538+0000","last_clean":"2024-08-17T02:28:09.959538+0000","last_became_active":"2024-08-17T02:28:09.958653+0000","last_became_peered":"2024-08-17T02:28:09.958653+0000","last_unstale":"2024-08-17T02:28:09.959538+0000","last_undegraded":"2024-08-17T02:28:09.959538+0000","last_fullsized":"2024-08-17T02:28:09.959538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:35.703904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.943081+0000","last_change":"2024-08-17T02:28:08.961839+0000","last_active":"2024-08-17T02:28:09.943081+0000","last_peered":"2024-08-17T02:28:09.943081+0000","last_clean":"2024-08-17T02:28:09.943081+0000","last_became_active":"2024-08-17T02:28:08.961243+0000","last_became_peered":"2024-08-17T02:28:08.961243+0000","last_unstale":"2024-08-17T02:28:09.943081+0000","last_undegraded":"2024-08-17T02:28:09.943081+0000","last_fullsized":"2024-08-17T02:28:09.943081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:36:26.816967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968844+0000","last_change":"2024-08-17T02:28:09.968844+0000","last_active":"2024-08-17T02:28:09.968844+0000","last_peered":"2024-08-17T02:28:09.968844+0000","last_clean":"2024-08-17T02:28:09.968844+0000","last_became_active":"2024-08-17T02:28:09.968511+0000","last_became_peered":"2024-08-17T02:28:09.968511+0000","last_unstale":"2024-08-17T02:28:09.968844+0000","last_undegraded":"2024-08-17T02:28:09.968844+0000","last_fullsized":"2024-08-17T02:28:09.968844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:36.354574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963236+0000","last_change":"2024-08-17T02:28:08.959613+0000","last_active":"2024-08-17T02:28:08.963236+0000","last_peered":"2024-08-17T02:28:08.963236+0000","last_clean":"2024-08-17T02:28:08.963236+0000","last_became_active":"2024-08-17T02:28:08.956566+0000","last_became_peered":"2024-08-17T02:28:08.956566+0000","last_unstale":"2024-08-17T02:28:08.963236+0000","last_undegraded":"2024-08-17T02:28:08.963236+0000","last_fullsized":"2024-08-17T02:28:08.963236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:31.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972246+0000","last_change":"2024-08-17T02:28:09.968478+0000","last_active":"2024-08-17T02:28:09.972246+0000","last_peered":"2024-08-17T02:28:09.972246+0000","last_clean":"2024-08-17T02:28:09.972246+0000","last_became_active":"2024-08-17T02:28:09.967938+0000","last_became_peered":"2024-08-17T02:28:09.967938+0000","last_unstale":"2024-08-17T02:28:09.972246+0000","last_undegraded":"2024-08-17T02:28:09.972246+0000","last_fullsized":"2024-08-17T02:28:09.972246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:25:13.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.959927+0000","last_change":"2024-08-17T02:28:08.958031+0000","last_active":"2024-08-17T02:28:08.959927+0000","last_peered":"2024-08-17T02:28:08.959927+0000","last_clean":"2024-08-17T02:28:08.959927+0000","last_became_active":"2024-08-17T02:28:08.957749+0000","last_became_peered":"2024-08-17T02:28:08.957749+0000","last_unstale":"2024-08-17T02:28:08.959927+0000","last_undegraded":"2024-08-17T02:28:08.959927+0000","last_fullsized":"2024-08-17T02:28:08.959927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:32.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972297+0000","last_change":"2024-08-17T02:28:09.972297+0000","last_active":"2024-08-17T02:28:09.972297+0000","last_peered":"2024-08-17T02:28:09.972297+0000","last_clean":"2024-08-17T02:28:09.972297+0000","last_became_active":"2024-08-17T02:28:09.972041+0000","last_became_peered":"2024-08-17T02:28:09.972041+0000","last_unstale":"2024-08-17T02:28:09.972297+0000","last_undegraded":"2024-08-17T02:28:09.972297+0000","last_fullsized":"2024-08-17T02:28:09.972297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962728+0000","last_change":"2024-08-17T02:28:08.961571+0000","last_active":"2024-08-17T02:28:08.962728+0000","last_peered":"2024-08-17T02:28:08.962728+0000","last_clean":"2024-08-17T02:28:08.962728+0000","last_became_active":"2024-08-17T02:28:08.960744+0000","last_became_peered":"2024-08-17T02:28:08.960744+0000","last_unstale":"2024-08-17T02:28:08.962728+0000","last_undegraded":"2024-08-17T02:28:08.962728+0000","last_fullsized":"2024-08-17T02:28:08.962728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:05.206197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962947+0000","last_change":"2024-08-17T02:28:09.962947+0000","last_active":"2024-08-17T02:28:09.962947+0000","last_peered":"2024-08-17T02:28:09.962947+0000","last_clean":"2024-08-17T02:28:09.962947+0000","last_became_active":"2024-08-17T02:28:09.962161+0000","last_became_peered":"2024-08-17T02:28:09.962161+0000","last_unstale":"2024-08-17T02:28:09.962947+0000","last_undegraded":"2024-08-17T02:28:09.962947+0000","last_fullsized":"2024-08-17T02:28:09.962947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970564+0000","last_change":"2024-08-17T02:28:08.958285+0000","last_active":"2024-08-17T02:28:09.970564+0000","last_peered":"2024-08-17T02:28:09.970564+0000","last_clean":"2024-08-17T02:28:09.970564+0000","last_became_active":"2024-08-17T02:28:08.957805+0000","last_became_peered":"2024-08-17T02:28:08.957805+0000","last_unstale":"2024-08-17T02:28:09.970564+0000","last_undegraded":"2024-08-17T02:28:09.970564+0000","last_fullsized":"2024-08-17T02:28:09.970564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:27.260237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972646+0000","last_change":"2024-08-17T02:28:09.968705+0000","last_active":"2024-08-17T02:28:09.972646+0000","last_peered":"2024-08-17T02:28:09.972646+0000","last_clean":"2024-08-17T02:28:09.972646+0000","last_became_active":"2024-08-17T02:28:09.968213+0000","last_became_peered":"2024-08-17T02:28:09.968213+0000","last_unstale":"2024-08-17T02:28:09.972646+0000","last_undegraded":"2024-08-17T02:28:09.972646+0000","last_fullsized":"2024-08-17T02:28:09.972646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:16.582318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972052+0000","last_change":"2024-08-17T02:28:08.962503+0000","last_active":"2024-08-17T02:28:09.972052+0000","last_peered":"2024-08-17T02:28:09.972052+0000","last_clean":"2024-08-17T02:28:09.972052+0000","last_became_active":"2024-08-17T02:28:08.961977+0000","last_became_peered":"2024-08-17T02:28:08.961977+0000","last_unstale":"2024-08-17T02:28:09.972052+0000","last_undegraded":"2024-08-17T02:28:09.972052+0000","last_fullsized":"2024-08-17T02:28:09.972052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:15.783042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959302+0000","last_change":"2024-08-17T02:28:09.959302+0000","last_active":"2024-08-17T02:28:09.959302+0000","last_peered":"2024-08-17T02:28:09.959302+0000","last_clean":"2024-08-17T02:28:09.959302+0000","last_became_active":"2024-08-17T02:28:09.958974+0000","last_became_peered":"2024-08-17T02:28:09.958974+0000","last_unstale":"2024-08-17T02:28:09.959302+0000","last_undegraded":"2024-08-17T02:28:09.959302+0000","last_fullsized":"2024-08-17T02:28:09.959302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:59.676456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971831+0000","last_change":"2024-08-17T02:28:08.961908+0000","last_active":"2024-08-17T02:28:09.971831+0000","last_peered":"2024-08-17T02:28:09.971831+0000","last_clean":"2024-08-17T02:28:09.971831+0000","last_became_active":"2024-08-17T02:28:08.960602+0000","last_became_peered":"2024-08-17T02:28:08.960602+0000","last_unstale":"2024-08-17T02:28:09.971831+0000","last_undegraded":"2024-08-17T02:28:09.971831+0000","last_fullsized":"2024-08-17T02:28:09.971831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:32.891014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968816+0000","last_change":"2024-08-17T02:28:09.968816+0000","last_active":"2024-08-17T02:28:09.968816+0000","last_peered":"2024-08-17T02:28:09.968816+0000","last_clean":"2024-08-17T02:28:09.968816+0000","last_became_active":"2024-08-17T02:28:09.966679+0000","last_became_peered":"2024-08-17T02:28:09.966679+0000","last_unstale":"2024-08-17T02:28:09.968816+0000","last_undegraded":"2024-08-17T02:28:09.968816+0000","last_fullsized":"2024-08-17T02:28:09.968816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:59.646807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962550+0000","last_change":"2024-08-17T02:28:08.960009+0000","last_active":"2024-08-17T02:28:08.962550+0000","last_peered":"2024-08-17T02:28:08.962550+0000","last_clean":"2024-08-17T02:28:08.962550+0000","last_became_active":"2024-08-17T02:28:08.959434+0000","last_became_peered":"2024-08-17T02:28:08.959434+0000","last_unstale":"2024-08-17T02:28:08.962550+0000","last_undegraded":"2024-08-17T02:28:08.962550+0000","last_fullsized":"2024-08-17T02:28:08.962550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:52.212717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.960627+0000","last_change":"2024-08-17T02:28:09.960627+0000","last_active":"2024-08-17T02:28:09.960627+0000","last_peered":"2024-08-17T02:28:09.960627+0000","last_clean":"2024-08-17T02:28:09.960627+0000","last_became_active":"2024-08-17T02:28:09.960357+0000","last_became_peered":"2024-08-17T02:28:09.960357+0000","last_unstale":"2024-08-17T02:28:09.960627+0000","last_undegraded":"2024-08-17T02:28:09.960627+0000","last_fullsized":"2024-08-17T02:28:09.960627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:33.431330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.956199+0000","last_change":"2024-08-17T02:28:08.954434+0000","last_active":"2024-08-17T02:28:08.956199+0000","last_peered":"2024-08-17T02:28:08.956199+0000","last_clean":"2024-08-17T02:28:08.956199+0000","last_became_active":"2024-08-17T02:28:08.953939+0000","last_became_peered":"2024-08-17T02:28:08.953939+0000","last_unstale":"2024-08-17T02:28:08.956199+0000","last_undegraded":"2024-08-17T02:28:08.956199+0000","last_fullsized":"2024-08-17T02:28:08.956199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:25.981859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970682+0000","last_change":"2024-08-17T02:28:09.962552+0000","last_active":"2024-08-17T02:28:09.970682+0000","last_peered":"2024-08-17T02:28:09.970682+0000","last_clean":"2024-08-17T02:28:09.970682+0000","last_became_active":"2024-08-17T02:28:09.962274+0000","last_became_peered":"2024-08-17T02:28:09.962274+0000","last_unstale":"2024-08-17T02:28:09.970682+0000","last_undegraded":"2024-08-17T02:28:09.970682+0000","last_fullsized":"2024-08-17T02:28:09.970682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:51.114341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971457+0000","last_change":"2024-08-17T02:28:08.958232+0000","last_active":"2024-08-17T02:28:09.971457+0000","last_peered":"2024-08-17T02:28:09.971457+0000","last_clean":"2024-08-17T02:28:09.971457+0000","last_became_active":"2024-08-17T02:28:08.957928+0000","last_became_peered":"2024-08-17T02:28:08.957928+0000","last_unstale":"2024-08-17T02:28:09.971457+0000","last_undegraded":"2024-08-17T02:28:09.971457+0000","last_fullsized":"2024-08-17T02:28:09.971457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:45.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972209+0000","last_change":"2024-08-17T02:28:09.968305+0000","last_active":"2024-08-17T02:28:09.972209+0000","last_peered":"2024-08-17T02:28:09.972209+0000","last_clean":"2024-08-17T02:28:09.972209+0000","last_became_active":"2024-08-17T02:28:09.967584+0000","last_became_peered":"2024-08-17T02:28:09.967584+0000","last_unstale":"2024-08-17T02:28:09.972209+0000","last_undegraded":"2024-08-17T02:28:09.972209+0000","last_fullsized":"2024-08-17T02:28:09.972209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:14.651454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964779+0000","last_change":"2024-08-17T02:28:08.954399+0000","last_active":"2024-08-17T02:28:09.964779+0000","last_peered":"2024-08-17T02:28:09.964779+0000","last_clean":"2024-08-17T02:28:09.964779+0000","last_became_active":"2024-08-17T02:28:08.954083+0000","last_became_peered":"2024-08-17T02:28:08.954083+0000","last_unstale":"2024-08-17T02:28:09.964779+0000","last_undegraded":"2024-08-17T02:28:09.964779+0000","last_fullsized":"2024-08-17T02:28:09.964779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:31.445203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968839+0000","last_change":"2024-08-17T02:28:09.965481+0000","last_active":"2024-08-17T02:28:09.968839+0000","last_peered":"2024-08-17T02:28:09.968839+0000","last_clean":"2024-08-17T02:28:09.968839+0000","last_became_active":"2024-08-17T02:28:09.965107+0000","last_became_peered":"2024-08-17T02:28:09.965107+0000","last_unstale":"2024-08-17T02:28:09.968839+0000","last_undegraded":"2024-08-17T02:28:09.968839+0000","last_fullsized":"2024-08-17T02:28:09.968839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:39:16.275692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971938+0000","last_change":"2024-08-17T02:28:08.962297+0000","last_active":"2024-08-17T02:28:09.971938+0000","last_peered":"2024-08-17T02:28:09.971938+0000","last_clean":"2024-08-17T02:28:09.971938+0000","last_became_active":"2024-08-17T02:28:08.960613+0000","last_became_peered":"2024-08-17T02:28:08.960613+0000","last_unstale":"2024-08-17T02:28:09.971938+0000","last_undegraded":"2024-08-17T02:28:09.971938+0000","last_fullsized":"2024-08-17T02:28:09.971938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:58.028118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970165+0000","last_change":"2024-08-17T02:28:09.970165+0000","last_active":"2024-08-17T02:28:09.970165+0000","last_peered":"2024-08-17T02:28:09.970165+0000","last_clean":"2024-08-17T02:28:09.970165+0000","last_became_active":"2024-08-17T02:28:09.969824+0000","last_became_peered":"2024-08-17T02:28:09.969824+0000","last_unstale":"2024-08-17T02:28:09.970165+0000","last_undegraded":"2024-08-17T02:28:09.970165+0000","last_fullsized":"2024-08-17T02:28:09.970165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972722+0000","last_change":"2024-08-17T02:28:08.955830+0000","last_active":"2024-08-17T02:28:09.972722+0000","last_peered":"2024-08-17T02:28:09.972722+0000","last_clean":"2024-08-17T02:28:09.972722+0000","last_became_active":"2024-08-17T02:28:08.955564+0000","last_became_peered":"2024-08-17T02:28:08.955564+0000","last_unstale":"2024-08-17T02:28:09.972722+0000","last_undegraded":"2024-08-17T02:28:09.972722+0000","last_fullsized":"2024-08-17T02:28:09.972722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:01.196580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962848+0000","last_change":"2024-08-17T02:28:09.956208+0000","last_active":"2024-08-17T02:28:09.962848+0000","last_peered":"2024-08-17T02:28:09.962848+0000","last_clean":"2024-08-17T02:28:09.962848+0000","last_became_active":"2024-08-17T02:28:09.955600+0000","last_became_peered":"2024-08-17T02:28:09.955600+0000","last_unstale":"2024-08-17T02:28:09.962848+0000","last_undegraded":"2024-08-17T02:28:09.962848+0000","last_fullsized":"2024-08-17T02:28:09.962848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:02.619138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.958481+0000","last_change":"2024-08-17T02:28:08.954720+0000","last_active":"2024-08-17T02:28:08.958481+0000","last_peered":"2024-08-17T02:28:08.958481+0000","last_clean":"2024-08-17T02:28:08.958481+0000","last_became_active":"2024-08-17T02:28:08.954475+0000","last_became_peered":"2024-08-17T02:28:08.954475+0000","last_unstale":"2024-08-17T02:28:08.958481+0000","last_undegraded":"2024-08-17T02:28:08.958481+0000","last_fullsized":"2024-08-17T02:28:08.958481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:31.217993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963176+0000","last_change":"2024-08-17T02:28:09.963176+0000","last_active":"2024-08-17T02:28:09.963176+0000","last_peered":"2024-08-17T02:28:09.963176+0000","last_clean":"2024-08-17T02:28:09.963176+0000","last_became_active":"2024-08-17T02:28:09.962858+0000","last_became_peered":"2024-08-17T02:28:09.962858+0000","last_unstale":"2024-08-17T02:28:09.963176+0000","last_undegraded":"2024-08-17T02:28:09.963176+0000","last_fullsized":"2024-08-17T02:28:09.963176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:36.900863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971628+0000","last_change":"2024-08-17T02:28:08.956063+0000","last_active":"2024-08-17T02:28:09.971628+0000","last_peered":"2024-08-17T02:28:09.971628+0000","last_clean":"2024-08-17T02:28:09.971628+0000","last_became_active":"2024-08-17T02:28:08.955378+0000","last_became_peered":"2024-08-17T02:28:08.955378+0000","last_unstale":"2024-08-17T02:28:09.971628+0000","last_undegraded":"2024-08-17T02:28:09.971628+0000","last_fullsized":"2024-08-17T02:28:09.971628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:59.157058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962154+0000","last_change":"2024-08-17T02:28:09.962154+0000","last_active":"2024-08-17T02:28:09.962154+0000","last_peered":"2024-08-17T02:28:09.962154+0000","last_clean":"2024-08-17T02:28:09.962154+0000","last_became_active":"2024-08-17T02:28:09.961866+0000","last_became_peered":"2024-08-17T02:28:09.961866+0000","last_unstale":"2024-08-17T02:28:09.962154+0000","last_undegraded":"2024-08-17T02:28:09.962154+0000","last_fullsized":"2024-08-17T02:28:09.962154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.964352+0000","last_change":"2024-08-17T02:28:08.961739+0000","last_active":"2024-08-17T02:28:08.964352+0000","last_peered":"2024-08-17T02:28:08.964352+0000","last_clean":"2024-08-17T02:28:08.964352+0000","last_became_active":"2024-08-17T02:28:08.961004+0000","last_became_peered":"2024-08-17T02:28:08.961004+0000","last_unstale":"2024-08-17T02:28:08.964352+0000","last_undegraded":"2024-08-17T02:28:08.964352+0000","last_fullsized":"2024-08-17T02:28:08.964352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:25.981859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967327+0000","last_change":"2024-08-17T02:28:09.967327+0000","last_active":"2024-08-17T02:28:09.967327+0000","last_peered":"2024-08-17T02:28:09.967327+0000","last_clean":"2024-08-17T02:28:09.967327+0000","last_became_active":"2024-08-17T02:28:09.967033+0000","last_became_peered":"2024-08-17T02:28:09.967033+0000","last_unstale":"2024-08-17T02:28:09.967327+0000","last_undegraded":"2024-08-17T02:28:09.967327+0000","last_fullsized":"2024-08-17T02:28:09.967327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:23:52.187109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.951125+0000","last_change":"2024-08-17T02:28:08.957518+0000","last_active":"2024-08-17T02:28:09.951125+0000","last_peered":"2024-08-17T02:28:09.951125+0000","last_clean":"2024-08-17T02:28:09.951125+0000","last_became_active":"2024-08-17T02:28:08.957171+0000","last_became_peered":"2024-08-17T02:28:08.957171+0000","last_unstale":"2024-08-17T02:28:09.951125+0000","last_undegraded":"2024-08-17T02:28:09.951125+0000","last_fullsized":"2024-08-17T02:28:09.951125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:45.128390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.958751+0000","last_change":"2024-08-17T02:28:09.957820+0000","last_active":"2024-08-17T02:28:09.958751+0000","last_peered":"2024-08-17T02:28:09.958751+0000","last_clean":"2024-08-17T02:28:09.958751+0000","last_became_active":"2024-08-17T02:28:09.957551+0000","last_became_peered":"2024-08-17T02:28:09.957551+0000","last_unstale":"2024-08-17T02:28:09.958751+0000","last_undegraded":"2024-08-17T02:28:09.958751+0000","last_fullsized":"2024-08-17T02:28:09.958751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:03.502209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.950382+0000","last_change":"2024-08-17T02:28:08.955027+0000","last_active":"2024-08-17T02:28:09.950382+0000","last_peered":"2024-08-17T02:28:09.950382+0000","last_clean":"2024-08-17T02:28:09.950382+0000","last_became_active":"2024-08-17T02:28:08.954761+0000","last_became_peered":"2024-08-17T02:28:08.954761+0000","last_unstale":"2024-08-17T02:28:09.950382+0000","last_undegraded":"2024-08-17T02:28:09.950382+0000","last_fullsized":"2024-08-17T02:28:09.950382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:33.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963529+0000","last_change":"2024-08-17T02:28:09.958642+0000","last_active":"2024-08-17T02:28:09.963529+0000","last_peered":"2024-08-17T02:28:09.963529+0000","last_clean":"2024-08-17T02:28:09.963529+0000","last_became_active":"2024-08-17T02:28:09.958368+0000","last_became_peered":"2024-08-17T02:28:09.958368+0000","last_unstale":"2024-08-17T02:28:09.963529+0000","last_undegraded":"2024-08-17T02:28:09.963529+0000","last_fullsized":"2024-08-17T02:28:09.963529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:59.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968401+0000","last_change":"2024-08-17T02:28:08.960858+0000","last_active":"2024-08-17T02:28:09.968401+0000","last_peered":"2024-08-17T02:28:09.968401+0000","last_clean":"2024-08-17T02:28:09.968401+0000","last_became_active":"2024-08-17T02:28:08.960504+0000","last_became_peered":"2024-08-17T02:28:08.960504+0000","last_unstale":"2024-08-17T02:28:09.968401+0000","last_undegraded":"2024-08-17T02:28:09.968401+0000","last_fullsized":"2024-08-17T02:28:09.968401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971007+0000","last_change":"2024-08-17T02:28:09.963866+0000","last_active":"2024-08-17T02:28:09.971007+0000","last_peered":"2024-08-17T02:28:09.971007+0000","last_clean":"2024-08-17T02:28:09.971007+0000","last_became_active":"2024-08-17T02:28:09.963606+0000","last_became_peered":"2024-08-17T02:28:09.963606+0000","last_unstale":"2024-08-17T02:28:09.971007+0000","last_undegraded":"2024-08-17T02:28:09.971007+0000","last_fullsized":"2024-08-17T02:28:09.971007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:55:39.156678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.959799+0000","last_change":"2024-08-17T02:28:08.957006+0000","last_active":"2024-08-17T02:28:08.959799+0000","last_peered":"2024-08-17T02:28:08.959799+0000","last_clean":"2024-08-17T02:28:08.959799+0000","last_became_active":"2024-08-17T02:28:08.956682+0000","last_became_peered":"2024-08-17T02:28:08.956682+0000","last_unstale":"2024-08-17T02:28:08.959799+0000","last_undegraded":"2024-08-17T02:28:08.959799+0000","last_fullsized":"2024-08-17T02:28:08.959799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:59.050167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.953755+0000","last_change":"2024-08-17T02:28:09.952413+0000","last_active":"2024-08-17T02:28:09.953755+0000","last_peered":"2024-08-17T02:28:09.953755+0000","last_clean":"2024-08-17T02:28:09.953755+0000","last_became_active":"2024-08-17T02:28:09.952012+0000","last_became_peered":"2024-08-17T02:28:09.952012+0000","last_unstale":"2024-08-17T02:28:09.953755+0000","last_undegraded":"2024-08-17T02:28:09.953755+0000","last_fullsized":"2024-08-17T02:28:09.953755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:26.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963384+0000","last_change":"2024-08-17T02:28:08.961340+0000","last_active":"2024-08-17T02:28:08.963384+0000","last_peered":"2024-08-17T02:28:08.963384+0000","last_clean":"2024-08-17T02:28:08.963384+0000","last_became_active":"2024-08-17T02:28:08.960305+0000","last_became_peered":"2024-08-17T02:28:08.960305+0000","last_unstale":"2024-08-17T02:28:08.963384+0000","last_undegraded":"2024-08-17T02:28:08.963384+0000","last_fullsized":"2024-08-17T02:28:08.963384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:02.498198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965539+0000","last_change":"2024-08-17T02:28:09.965539+0000","last_active":"2024-08-17T02:28:09.965539+0000","last_peered":"2024-08-17T02:28:09.965539+0000","last_clean":"2024-08-17T02:28:09.965539+0000","last_became_active":"2024-08-17T02:28:09.964917+0000","last_became_peered":"2024-08-17T02:28:09.964917+0000","last_unstale":"2024-08-17T02:28:09.965539+0000","last_undegraded":"2024-08-17T02:28:09.965539+0000","last_fullsized":"2024-08-17T02:28:09.965539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:23:41.338655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963288+0000","last_change":"2024-08-17T02:28:08.962183+0000","last_active":"2024-08-17T02:28:08.963288+0000","last_peered":"2024-08-17T02:28:08.963288+0000","last_clean":"2024-08-17T02:28:08.963288+0000","last_became_active":"2024-08-17T02:28:08.960909+0000","last_became_peered":"2024-08-17T02:28:08.960909+0000","last_unstale":"2024-08-17T02:28:08.963288+0000","last_undegraded":"2024-08-17T02:28:08.963288+0000","last_fullsized":"2024-08-17T02:28:08.963288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:34.699893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963034+0000","last_change":"2024-08-17T02:28:09.963034+0000","last_active":"2024-08-17T02:28:09.963034+0000","last_peered":"2024-08-17T02:28:09.963034+0000","last_clean":"2024-08-17T02:28:09.963034+0000","last_became_active":"2024-08-17T02:28:09.962772+0000","last_became_peered":"2024-08-17T02:28:09.962772+0000","last_unstale":"2024-08-17T02:28:09.963034+0000","last_undegraded":"2024-08-17T02:28:09.963034+0000","last_fullsized":"2024-08-17T02:28:09.963034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:17.045087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962723+0000","last_change":"2024-08-17T02:28:08.960666+0000","last_active":"2024-08-17T02:28:08.962723+0000","last_peered":"2024-08-17T02:28:08.962723+0000","last_clean":"2024-08-17T02:28:08.962723+0000","last_became_active":"2024-08-17T02:28:08.960357+0000","last_became_peered":"2024-08-17T02:28:08.960357+0000","last_unstale":"2024-08-17T02:28:08.962723+0000","last_undegraded":"2024-08-17T02:28:08.962723+0000","last_fullsized":"2024-08-17T02:28:08.962723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:44.526453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.960250+0000","last_change":"2024-08-17T02:28:09.960250+0000","last_active":"2024-08-17T02:28:09.960250+0000","last_peered":"2024-08-17T02:28:09.960250+0000","last_clean":"2024-08-17T02:28:09.960250+0000","last_became_active":"2024-08-17T02:28:09.958564+0000","last_became_peered":"2024-08-17T02:28:09.958564+0000","last_unstale":"2024-08-17T02:28:09.960250+0000","last_undegraded":"2024-08-17T02:28:09.960250+0000","last_fullsized":"2024-08-17T02:28:09.960250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.964237+0000","last_change":"2024-08-17T02:28:08.961782+0000","last_active":"2024-08-17T02:28:08.964237+0000","last_peered":"2024-08-17T02:28:08.964237+0000","last_clean":"2024-08-17T02:28:08.964237+0000","last_became_active":"2024-08-17T02:28:08.961138+0000","last_became_peered":"2024-08-17T02:28:08.961138+0000","last_unstale":"2024-08-17T02:28:08.964237+0000","last_undegraded":"2024-08-17T02:28:08.964237+0000","last_fullsized":"2024-08-17T02:28:08.964237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:52.212717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970292+0000","last_change":"2024-08-17T02:28:09.958792+0000","last_active":"2024-08-17T02:28:09.970292+0000","last_peered":"2024-08-17T02:28:09.970292+0000","last_clean":"2024-08-17T02:28:09.970292+0000","last_became_active":"2024-08-17T02:28:09.956528+0000","last_became_peered":"2024-08-17T02:28:09.956528+0000","last_unstale":"2024-08-17T02:28:09.970292+0000","last_undegraded":"2024-08-17T02:28:09.970292+0000","last_fullsized":"2024-08-17T02:28:09.970292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:24.244682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.958482+0000","last_change":"2024-08-17T02:28:08.957335+0000","last_active":"2024-08-17T02:28:08.958482+0000","last_peered":"2024-08-17T02:28:08.958482+0000","last_clean":"2024-08-17T02:28:08.958482+0000","last_became_active":"2024-08-17T02:28:08.956749+0000","last_became_peered":"2024-08-17T02:28:08.956749+0000","last_unstale":"2024-08-17T02:28:08.958482+0000","last_undegraded":"2024-08-17T02:28:08.958482+0000","last_fullsized":"2024-08-17T02:28:08.958482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:58.028118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965420+0000","last_change":"2024-08-17T02:28:09.965420+0000","last_active":"2024-08-17T02:28:09.965420+0000","last_peered":"2024-08-17T02:28:09.965420+0000","last_clean":"2024-08-17T02:28:09.965420+0000","last_became_active":"2024-08-17T02:28:09.965017+0000","last_became_peered":"2024-08-17T02:28:09.965017+0000","last_unstale":"2024-08-17T02:28:09.965420+0000","last_undegraded":"2024-08-17T02:28:09.965420+0000","last_fullsized":"2024-08-17T02:28:09.965420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:39.849587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.954969+0000","last_change":"2024-08-17T02:28:08.955290+0000","last_active":"2024-08-17T02:28:09.954969+0000","last_peered":"2024-08-17T02:28:09.954969+0000","last_clean":"2024-08-17T02:28:09.954969+0000","last_became_active":"2024-08-17T02:28:08.955012+0000","last_became_peered":"2024-08-17T02:28:08.955012+0000","last_unstale":"2024-08-17T02:28:09.954969+0000","last_undegraded":"2024-08-17T02:28:09.954969+0000","last_fullsized":"2024-08-17T02:28:09.954969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:05.267667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.949134+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:28:09.949134+0000","last_peered":"2024-08-17T02:28:09.949134+0000","last_clean":"2024-08-17T02:28:09.949134+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:28:09.949134+0000","last_undegraded":"2024-08-17T02:28:09.949134+0000","last_fullsized":"2024-08-17T02:28:09.949134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":130591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":132121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":937984,"data_stored":720496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":132143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":131333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":348160,"data_stored":130603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":942080,"data_stored":721007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301856,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069984,"statfs":{"total":96636764160,"available":96327663616,"internally_reserved":0,"allocated":348160,"data_stored":130659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:13.475 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.620+0000 7f4f26e4b700 1 Processor -- start 2024-08-17T02:28:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.620+0000 7f4f26e4b700 1 -- start start 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f200687a0 0x7f4f2006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2015ce60 con 0x7f4f20153a50 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f200ae710 con 0x7f4f2006d830 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2006dc30 con 0x7f4f200687a0 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f24be7700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4f20153a50 0x7f4f200ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35056/0 (socket says 172.21.15.155:35056) 2024-08-17T02:28:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f24be7700 1 -- 172.21.15.155:0/1717041182 learned_addr learned my addr 172.21.15.155:0/1717041182 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1ffff700 1 --2- 172.21.15.155:0/1717041182 >> v2:172.21.15.155:3300/0 conn(0x7f4f200687a0 0x7f4f2006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1f7fe700 1 -- 172.21.15.155:0/1717041182 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352852235 0 0) 0x7f4f2015ce60 con 0x7f4f20153a50 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1f7fe700 1 -- 172.21.15.155:0/1717041182 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f0c003570 con 0x7f4f20153a50 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1ffff700 1 -- 172.21.15.155:0/1717041182 >> v1:172.21.15.189:6789/0 conn(0x7f4f2006d830 legacy=0x7f4f200afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1ffff700 1 -- 172.21.15.155:0/1717041182 >> v1:172.21.15.155:6789/0 conn(0x7f4f20153a50 legacy=0x7f4f200ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1ffff700 1 -- 172.21.15.155:0/1717041182 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20068bd0 con 0x7f4f200687a0 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1ffff700 1 --2- 172.21.15.155:0/1717041182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200687a0 0x7f4f2006d2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f080098e0 tx=0x7f4f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9832a9f9ef7a6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1f7fe700 1 -- 172.21.15.155:0/1717041182 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800b640 con 0x7f4f200687a0 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1f7fe700 1 -- 172.21.15.155:0/1717041182 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800b7a0 con 0x7f4f200687a0 2024-08-17T02:28:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f1f7fe700 1 -- 172.21.15.155:0/1717041182 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800bb40 con 0x7f4f200687a0 2024-08-17T02:28:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- 172.21.15.155:0/1717041182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200687a0 msgr2=0x7f4f2006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/1717041182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200687a0 0x7f4f2006d2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f080098e0 tx=0x7f4f080091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- 172.21.15.155:0/1717041182 shutdown_connections 2024-08-17T02:28:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/1717041182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f200687a0 0x7f4f2006d2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- 172.21.15.155:0/1717041182 >> 172.21.15.155:0/1717041182 conn(0x7f4f200ceb30 msgr2=0x7f4f2006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- 172.21.15.155:0/1717041182 shutdown_connections 2024-08-17T02:28:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.624+0000 7f4f26e4b700 1 -- 172.21.15.155:0/1717041182 wait complete. 2024-08-17T02:28:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 Processor -- start 2024-08-17T02:28:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 -- start start 2024-08-17T02:28:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f200687a0 0x7f4f201527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f20153a50 0x7f4f201584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200c98b0 con 0x7f4f2006d830 2024-08-17T02:28:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2016aa60 con 0x7f4f200687a0 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f26e4b700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20169ee0 con 0x7f4f20153a50 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f1ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f1ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44912/0 (socket says 172.21.15.155:44912) 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f1ffff700 1 -- 172.21.15.155:0/2224879063 learned_addr learned my addr 172.21.15.155:0/2224879063 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f24be7700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f200687a0 0x7f4f201527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.628+0000 7f4f253e8700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f20153a50 0x7f4f201584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 -- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f20153a50 msgr2=0x7f4f201584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f20153a50 0x7f4f201584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 -- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f200687a0 msgr2=0x7f4f201527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f200687a0 0x7f4f201527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 -- 172.21.15.155:0/2224879063 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009420 con 0x7f4f2006d830 2024-08-17T02:28:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1ffff700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f200af660 tx=0x7f4f08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800bb20 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2016a1c0 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08011420 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080117a0 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2016a780 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f200645c0 con 0x7f4f2006d830 2024-08-17T02:28:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.632+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4f08011b10 con 0x7f4f2006d830 2024-08-17T02:28:13.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.636+0000 7f4f1cff9700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 0x7f4f00062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.636+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f0807df90 con 0x7f4f2006d830 2024-08-17T02:28:13.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.636+0000 7f4f24be7700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 0x7f4f00062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.636+0000 7f4f24be7700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 0x7f4f00062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005c50 tx=0x7f4f10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.640+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4f080ae480 con 0x7f4f2006d830 2024-08-17T02:28:13.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.800+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f200b3060 con 0x7f4f00060860 2024-08-17T02:28:13.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.812+0000 7f4f1cff9700 1 -- 172.21.15.155:0/2224879063 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264538 (secure 0 0 0) 0x7f4f200b3060 con 0x7f4f00060860 2024-08-17T02:28:13.819 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 msgr2=0x7f4f00062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 0x7f4f00062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005c50 tx=0x7f4f10009040 comp rx=0 tx=0).stop 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 msgr2=0x7f4f20157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f200af660 tx=0x7f4f08017000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 shutdown_connections 2024-08-17T02:28:13.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4f00060860 0x7f4f00062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4f20153a50 0x7f4f201584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2006d830 0x7f4f20157f90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 --2- 172.21.15.155:0/2224879063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4f200687a0 0x7f4f201527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 >> 172.21.15.155:0/2224879063 conn(0x7f4f200ceb30 msgr2=0x7f4f2006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 shutdown_connections 2024-08-17T02:28:13.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.816+0000 7f4f26e4b700 1 -- 172.21.15.155:0/2224879063 wait complete. 2024-08-17T02:28:13.823 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:28:13.834 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-08-17T02:28:11.952967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391120,"kb_used_data":3908,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583600,"statfs":{"total":773094113280,"available":770645606400,"internally_reserved":0,"allocated":4001792,"data_stored":2228953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026527"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962728+0000","last_change":"2024-08-17T02:28:09.962728+0000","last_active":"2024-08-17T02:28:09.962728+0000","last_peered":"2024-08-17T02:28:09.962728+0000","last_clean":"2024-08-17T02:28:09.962728+0000","last_became_active":"2024-08-17T02:28:09.961974+0000","last_became_peered":"2024-08-17T02:28:09.961974+0000","last_unstale":"2024-08-17T02:28:09.962728+0000","last_undegraded":"2024-08-17T02:28:09.962728+0000","last_fullsized":"2024-08-17T02:28:09.962728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:36.354574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967800+0000","last_change":"2024-08-17T02:28:09.967800+0000","last_active":"2024-08-17T02:28:09.967800+0000","last_peered":"2024-08-17T02:28:09.967800+0000","last_clean":"2024-08-17T02:28:09.967800+0000","last_became_active":"2024-08-17T02:28:09.967384+0000","last_became_peered":"2024-08-17T02:28:09.967384+0000","last_unstale":"2024-08-17T02:28:09.967800+0000","last_undegraded":"2024-08-17T02:28:09.967800+0000","last_fullsized":"2024-08-17T02:28:09.967800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966553+0000","last_change":"2024-08-17T02:28:09.961569+0000","last_active":"2024-08-17T02:28:09.966553+0000","last_peered":"2024-08-17T02:28:09.966553+0000","last_clean":"2024-08-17T02:28:09.966553+0000","last_became_active":"2024-08-17T02:28:09.961276+0000","last_became_peered":"2024-08-17T02:28:09.961276+0000","last_unstale":"2024-08-17T02:28:09.966553+0000","last_undegraded":"2024-08-17T02:28:09.966553+0000","last_fullsized":"2024-08-17T02:28:09.966553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:26.171844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963105+0000","last_change":"2024-08-17T02:28:09.963105+0000","last_active":"2024-08-17T02:28:09.963105+0000","last_peered":"2024-08-17T02:28:09.963105+0000","last_clean":"2024-08-17T02:28:09.963105+0000","last_became_active":"2024-08-17T02:28:09.962618+0000","last_became_peered":"2024-08-17T02:28:09.962618+0000","last_unstale":"2024-08-17T02:28:09.963105+0000","last_undegraded":"2024-08-17T02:28:09.963105+0000","last_fullsized":"2024-08-17T02:28:09.963105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966725+0000","last_change":"2024-08-17T02:28:09.966725+0000","last_active":"2024-08-17T02:28:09.966725+0000","last_peered":"2024-08-17T02:28:09.966725+0000","last_clean":"2024-08-17T02:28:09.966725+0000","last_became_active":"2024-08-17T02:28:09.966455+0000","last_became_peered":"2024-08-17T02:28:09.966455+0000","last_unstale":"2024-08-17T02:28:09.966725+0000","last_undegraded":"2024-08-17T02:28:09.966725+0000","last_fullsized":"2024-08-17T02:28:09.966725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959600+0000","last_change":"2024-08-17T02:28:09.954287+0000","last_active":"2024-08-17T02:28:09.959600+0000","last_peered":"2024-08-17T02:28:09.959600+0000","last_clean":"2024-08-17T02:28:09.959600+0000","last_became_active":"2024-08-17T02:28:09.951978+0000","last_became_peered":"2024-08-17T02:28:09.951978+0000","last_unstale":"2024-08-17T02:28:09.959600+0000","last_undegraded":"2024-08-17T02:28:09.959600+0000","last_fullsized":"2024-08-17T02:28:09.959600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:47.651804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.961032+0000","last_change":"2024-08-17T02:28:09.961032+0000","last_active":"2024-08-17T02:28:09.961032+0000","last_peered":"2024-08-17T02:28:09.961032+0000","last_clean":"2024-08-17T02:28:09.961032+0000","last_became_active":"2024-08-17T02:28:09.958590+0000","last_became_peered":"2024-08-17T02:28:09.958590+0000","last_unstale":"2024-08-17T02:28:09.961032+0000","last_undegraded":"2024-08-17T02:28:09.961032+0000","last_fullsized":"2024-08-17T02:28:09.961032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967537+0000","last_change":"2024-08-17T02:28:09.967537+0000","last_active":"2024-08-17T02:28:09.967537+0000","last_peered":"2024-08-17T02:28:09.967537+0000","last_clean":"2024-08-17T02:28:09.967537+0000","last_became_active":"2024-08-17T02:28:09.967302+0000","last_became_peered":"2024-08-17T02:28:09.967302+0000","last_unstale":"2024-08-17T02:28:09.967537+0000","last_undegraded":"2024-08-17T02:28:09.967537+0000","last_fullsized":"2024-08-17T02:28:09.967537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:32.358321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968803+0000","last_change":"2024-08-17T02:28:09.963107+0000","last_active":"2024-08-17T02:28:09.968803+0000","last_peered":"2024-08-17T02:28:09.968803+0000","last_clean":"2024-08-17T02:28:09.968803+0000","last_became_active":"2024-08-17T02:28:09.962823+0000","last_became_peered":"2024-08-17T02:28:09.962823+0000","last_unstale":"2024-08-17T02:28:09.968803+0000","last_undegraded":"2024-08-17T02:28:09.968803+0000","last_fullsized":"2024-08-17T02:28:09.968803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:45.530464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.969835+0000","last_change":"2024-08-17T02:28:09.969835+0000","last_active":"2024-08-17T02:28:09.969835+0000","last_peered":"2024-08-17T02:28:09.969835+0000","last_clean":"2024-08-17T02:28:09.969835+0000","last_became_active":"2024-08-17T02:28:09.969480+0000","last_became_peered":"2024-08-17T02:28:09.969480+0000","last_unstale":"2024-08-17T02:28:09.969835+0000","last_undegraded":"2024-08-17T02:28:09.969835+0000","last_fullsized":"2024-08-17T02:28:09.969835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:02.200591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972630+0000","last_change":"2024-08-17T02:28:09.968536+0000","last_active":"2024-08-17T02:28:09.972630+0000","last_peered":"2024-08-17T02:28:09.972630+0000","last_clean":"2024-08-17T02:28:09.972630+0000","last_became_active":"2024-08-17T02:28:09.967877+0000","last_became_peered":"2024-08-17T02:28:09.967877+0000","last_unstale":"2024-08-17T02:28:09.972630+0000","last_undegraded":"2024-08-17T02:28:09.972630+0000","last_fullsized":"2024-08-17T02:28:09.972630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:06:33.116610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968893+0000","last_change":"2024-08-17T02:28:09.966942+0000","last_active":"2024-08-17T02:28:09.968893+0000","last_peered":"2024-08-17T02:28:09.968893+0000","last_clean":"2024-08-17T02:28:09.968893+0000","last_became_active":"2024-08-17T02:28:09.966009+0000","last_became_peered":"2024-08-17T02:28:09.966009+0000","last_unstale":"2024-08-17T02:28:09.968893+0000","last_undegraded":"2024-08-17T02:28:09.968893+0000","last_fullsized":"2024-08-17T02:28:09.968893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:34.183511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964451+0000","last_change":"2024-08-17T02:28:09.964451+0000","last_active":"2024-08-17T02:28:09.964451+0000","last_peered":"2024-08-17T02:28:09.964451+0000","last_clean":"2024-08-17T02:28:09.964451+0000","last_became_active":"2024-08-17T02:28:09.963936+0000","last_became_peered":"2024-08-17T02:28:09.963936+0000","last_unstale":"2024-08-17T02:28:09.964451+0000","last_undegraded":"2024-08-17T02:28:09.964451+0000","last_fullsized":"2024-08-17T02:28:09.964451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:19.290734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972072+0000","last_change":"2024-08-17T02:28:09.972072+0000","last_active":"2024-08-17T02:28:09.972072+0000","last_peered":"2024-08-17T02:28:09.972072+0000","last_clean":"2024-08-17T02:28:09.972072+0000","last_became_active":"2024-08-17T02:28:09.971786+0000","last_became_peered":"2024-08-17T02:28:09.971786+0000","last_unstale":"2024-08-17T02:28:09.972072+0000","last_undegraded":"2024-08-17T02:28:09.972072+0000","last_fullsized":"2024-08-17T02:28:09.972072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966210+0000","last_change":"2024-08-17T02:28:09.966210+0000","last_active":"2024-08-17T02:28:09.966210+0000","last_peered":"2024-08-17T02:28:09.966210+0000","last_clean":"2024-08-17T02:28:09.966210+0000","last_became_active":"2024-08-17T02:28:09.965950+0000","last_became_peered":"2024-08-17T02:28:09.965950+0000","last_unstale":"2024-08-17T02:28:09.966210+0000","last_undegraded":"2024-08-17T02:28:09.966210+0000","last_fullsized":"2024-08-17T02:28:09.966210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:07.448201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965395+0000","last_change":"2024-08-17T02:28:09.965395+0000","last_active":"2024-08-17T02:28:09.965395+0000","last_peered":"2024-08-17T02:28:09.965395+0000","last_clean":"2024-08-17T02:28:09.965395+0000","last_became_active":"2024-08-17T02:28:09.965069+0000","last_became_peered":"2024-08-17T02:28:09.965069+0000","last_unstale":"2024-08-17T02:28:09.965395+0000","last_undegraded":"2024-08-17T02:28:09.965395+0000","last_fullsized":"2024-08-17T02:28:09.965395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:38.530842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970990+0000","last_change":"2024-08-17T02:28:09.963410+0000","last_active":"2024-08-17T02:28:09.970990+0000","last_peered":"2024-08-17T02:28:09.970990+0000","last_clean":"2024-08-17T02:28:09.970990+0000","last_became_active":"2024-08-17T02:28:09.963143+0000","last_became_peered":"2024-08-17T02:28:09.963143+0000","last_unstale":"2024-08-17T02:28:09.970990+0000","last_undegraded":"2024-08-17T02:28:09.970990+0000","last_fullsized":"2024-08-17T02:28:09.970990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:06:28.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967687+0000","last_change":"2024-08-17T02:28:09.966376+0000","last_active":"2024-08-17T02:28:09.967687+0000","last_peered":"2024-08-17T02:28:09.967687+0000","last_clean":"2024-08-17T02:28:09.967687+0000","last_became_active":"2024-08-17T02:28:09.966081+0000","last_became_peered":"2024-08-17T02:28:09.966081+0000","last_unstale":"2024-08-17T02:28:09.967687+0000","last_undegraded":"2024-08-17T02:28:09.967687+0000","last_fullsized":"2024-08-17T02:28:09.967687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:01.981247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964165+0000","last_change":"2024-08-17T02:28:09.959901+0000","last_active":"2024-08-17T02:28:09.964165+0000","last_peered":"2024-08-17T02:28:09.964165+0000","last_clean":"2024-08-17T02:28:09.964165+0000","last_became_active":"2024-08-17T02:28:09.959321+0000","last_became_peered":"2024-08-17T02:28:09.959321+0000","last_unstale":"2024-08-17T02:28:09.964165+0000","last_undegraded":"2024-08-17T02:28:09.964165+0000","last_fullsized":"2024-08-17T02:28:09.964165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:11:15.213225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965555+0000","last_change":"2024-08-17T02:28:09.965555+0000","last_active":"2024-08-17T02:28:09.965555+0000","last_peered":"2024-08-17T02:28:09.965555+0000","last_clean":"2024-08-17T02:28:09.965555+0000","last_became_active":"2024-08-17T02:28:09.965262+0000","last_became_peered":"2024-08-17T02:28:09.965262+0000","last_unstale":"2024-08-17T02:28:09.965555+0000","last_undegraded":"2024-08-17T02:28:09.965555+0000","last_fullsized":"2024-08-17T02:28:09.965555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:44.502297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967087+0000","last_change":"2024-08-17T02:28:09.967087+0000","last_active":"2024-08-17T02:28:09.967087+0000","last_peered":"2024-08-17T02:28:09.967087+0000","last_clean":"2024-08-17T02:28:09.967087+0000","last_became_active":"2024-08-17T02:28:09.966814+0000","last_became_peered":"2024-08-17T02:28:09.966814+0000","last_unstale":"2024-08-17T02:28:09.967087+0000","last_undegraded":"2024-08-17T02:28:09.967087+0000","last_fullsized":"2024-08-17T02:28:09.967087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:43.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.961751+0000","last_change":"2024-08-17T02:28:09.961751+0000","last_active":"2024-08-17T02:28:09.961751+0000","last_peered":"2024-08-17T02:28:09.961751+0000","last_clean":"2024-08-17T02:28:09.961751+0000","last_became_active":"2024-08-17T02:28:09.961514+0000","last_became_peered":"2024-08-17T02:28:09.961514+0000","last_unstale":"2024-08-17T02:28:09.961751+0000","last_undegraded":"2024-08-17T02:28:09.961751+0000","last_fullsized":"2024-08-17T02:28:09.961751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:06.271678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959428+0000","last_change":"2024-08-17T02:28:09.959428+0000","last_active":"2024-08-17T02:28:09.959428+0000","last_peered":"2024-08-17T02:28:09.959428+0000","last_clean":"2024-08-17T02:28:09.959428+0000","last_became_active":"2024-08-17T02:28:09.958953+0000","last_became_peered":"2024-08-17T02:28:09.958953+0000","last_unstale":"2024-08-17T02:28:09.959428+0000","last_undegraded":"2024-08-17T02:28:09.959428+0000","last_fullsized":"2024-08-17T02:28:09.959428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:24.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959343+0000","last_change":"2024-08-17T02:28:09.959343+0000","last_active":"2024-08-17T02:28:09.959343+0000","last_peered":"2024-08-17T02:28:09.959343+0000","last_clean":"2024-08-17T02:28:09.959343+0000","last_became_active":"2024-08-17T02:28:09.958674+0000","last_became_peered":"2024-08-17T02:28:09.958674+0000","last_unstale":"2024-08-17T02:28:09.959343+0000","last_undegraded":"2024-08-17T02:28:09.959343+0000","last_fullsized":"2024-08-17T02:28:09.959343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:02.200591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971724+0000","last_change":"2024-08-17T02:28:09.971724+0000","last_active":"2024-08-17T02:28:09.971724+0000","last_peered":"2024-08-17T02:28:09.971724+0000","last_clean":"2024-08-17T02:28:09.971724+0000","last_became_active":"2024-08-17T02:28:09.971443+0000","last_became_peered":"2024-08-17T02:28:09.971443+0000","last_unstale":"2024-08-17T02:28:09.971724+0000","last_undegraded":"2024-08-17T02:28:09.971724+0000","last_fullsized":"2024-08-17T02:28:09.971724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:04:32.358321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962205+0000","last_change":"2024-08-17T02:28:09.962205+0000","last_active":"2024-08-17T02:28:09.962205+0000","last_peered":"2024-08-17T02:28:09.962205+0000","last_clean":"2024-08-17T02:28:09.962205+0000","last_became_active":"2024-08-17T02:28:09.961926+0000","last_became_peered":"2024-08-17T02:28:09.961926+0000","last_unstale":"2024-08-17T02:28:09.962205+0000","last_undegraded":"2024-08-17T02:28:09.962205+0000","last_fullsized":"2024-08-17T02:28:09.962205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:09.369356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964879+0000","last_change":"2024-08-17T02:28:09.964879+0000","last_active":"2024-08-17T02:28:09.964879+0000","last_peered":"2024-08-17T02:28:09.964879+0000","last_clean":"2024-08-17T02:28:09.964879+0000","last_became_active":"2024-08-17T02:28:09.962231+0000","last_became_peered":"2024-08-17T02:28:09.962231+0000","last_unstale":"2024-08-17T02:28:09.964879+0000","last_undegraded":"2024-08-17T02:28:09.964879+0000","last_fullsized":"2024-08-17T02:28:09.964879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966339+0000","last_change":"2024-08-17T02:28:09.966339+0000","last_active":"2024-08-17T02:28:09.966339+0000","last_peered":"2024-08-17T02:28:09.966339+0000","last_clean":"2024-08-17T02:28:09.966339+0000","last_became_active":"2024-08-17T02:28:09.966068+0000","last_became_peered":"2024-08-17T02:28:09.966068+0000","last_unstale":"2024-08-17T02:28:09.966339+0000","last_undegraded":"2024-08-17T02:28:09.966339+0000","last_fullsized":"2024-08-17T02:28:09.966339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:34.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965825+0000","last_change":"2024-08-17T02:28:09.965825+0000","last_active":"2024-08-17T02:28:09.965825+0000","last_peered":"2024-08-17T02:28:09.965825+0000","last_clean":"2024-08-17T02:28:09.965825+0000","last_became_active":"2024-08-17T02:28:09.965549+0000","last_became_peered":"2024-08-17T02:28:09.965549+0000","last_unstale":"2024-08-17T02:28:09.965825+0000","last_undegraded":"2024-08-17T02:28:09.965825+0000","last_fullsized":"2024-08-17T02:28:09.965825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:28.828696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967493+0000","last_change":"2024-08-17T02:28:09.967493+0000","last_active":"2024-08-17T02:28:09.967493+0000","last_peered":"2024-08-17T02:28:09.967493+0000","last_clean":"2024-08-17T02:28:09.967493+0000","last_became_active":"2024-08-17T02:28:09.967204+0000","last_became_peered":"2024-08-17T02:28:09.967204+0000","last_unstale":"2024-08-17T02:28:09.967493+0000","last_undegraded":"2024-08-17T02:28:09.967493+0000","last_fullsized":"2024-08-17T02:28:09.967493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:15.931938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.958260+0000","last_change":"2024-08-17T02:28:09.958260+0000","last_active":"2024-08-17T02:28:09.958260+0000","last_peered":"2024-08-17T02:28:09.958260+0000","last_clean":"2024-08-17T02:28:09.958260+0000","last_became_active":"2024-08-17T02:28:09.957902+0000","last_became_peered":"2024-08-17T02:28:09.957902+0000","last_unstale":"2024-08-17T02:28:09.958260+0000","last_undegraded":"2024-08-17T02:28:09.958260+0000","last_fullsized":"2024-08-17T02:28:09.958260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970526+0000","last_change":"2024-08-17T02:28:09.961933+0000","last_active":"2024-08-17T02:28:09.970526+0000","last_peered":"2024-08-17T02:28:09.970526+0000","last_clean":"2024-08-17T02:28:09.970526+0000","last_became_active":"2024-08-17T02:28:09.961646+0000","last_became_peered":"2024-08-17T02:28:09.961646+0000","last_unstale":"2024-08-17T02:28:09.970526+0000","last_undegraded":"2024-08-17T02:28:09.970526+0000","last_fullsized":"2024-08-17T02:28:09.970526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:15.479646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965265+0000","last_change":"2024-08-17T02:28:09.965265+0000","last_active":"2024-08-17T02:28:09.965265+0000","last_peered":"2024-08-17T02:28:09.965265+0000","last_clean":"2024-08-17T02:28:09.965265+0000","last_became_active":"2024-08-17T02:28:09.964908+0000","last_became_peered":"2024-08-17T02:28:09.964908+0000","last_unstale":"2024-08-17T02:28:09.965265+0000","last_undegraded":"2024-08-17T02:28:09.965265+0000","last_fullsized":"2024-08-17T02:28:09.965265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:16.656067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971287+0000","last_change":"2024-08-17T02:28:08.961034+0000","last_active":"2024-08-17T02:28:09.971287+0000","last_peered":"2024-08-17T02:28:09.971287+0000","last_clean":"2024-08-17T02:28:09.971287+0000","last_became_active":"2024-08-17T02:28:08.960743+0000","last_became_peered":"2024-08-17T02:28:08.960743+0000","last_unstale":"2024-08-17T02:28:09.971287+0000","last_undegraded":"2024-08-17T02:28:09.971287+0000","last_fullsized":"2024-08-17T02:28:09.971287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:35.350563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966178+0000","last_change":"2024-08-17T02:28:09.966178+0000","last_active":"2024-08-17T02:28:09.966178+0000","last_peered":"2024-08-17T02:28:09.966178+0000","last_clean":"2024-08-17T02:28:09.966178+0000","last_became_active":"2024-08-17T02:28:09.965933+0000","last_became_peered":"2024-08-17T02:28:09.965933+0000","last_unstale":"2024-08-17T02:28:09.966178+0000","last_undegraded":"2024-08-17T02:28:09.966178+0000","last_fullsized":"2024-08-17T02:28:09.966178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:39.694959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.954263+0000","last_change":"2024-08-17T02:28:08.956421+0000","last_active":"2024-08-17T02:28:09.954263+0000","last_peered":"2024-08-17T02:28:09.954263+0000","last_clean":"2024-08-17T02:28:09.954263+0000","last_became_active":"2024-08-17T02:28:08.956081+0000","last_became_peered":"2024-08-17T02:28:08.956081+0000","last_unstale":"2024-08-17T02:28:09.954263+0000","last_undegraded":"2024-08-17T02:28:09.954263+0000","last_fullsized":"2024-08-17T02:28:09.954263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:46.647793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.969966+0000","last_change":"2024-08-17T02:28:09.969966+0000","last_active":"2024-08-17T02:28:09.969966+0000","last_peered":"2024-08-17T02:28:09.969966+0000","last_clean":"2024-08-17T02:28:09.969966+0000","last_became_active":"2024-08-17T02:28:09.969519+0000","last_became_peered":"2024-08-17T02:28:09.969519+0000","last_unstale":"2024-08-17T02:28:09.969966+0000","last_undegraded":"2024-08-17T02:28:09.969966+0000","last_fullsized":"2024-08-17T02:28:09.969966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970055+0000","last_change":"2024-08-17T02:28:08.958635+0000","last_active":"2024-08-17T02:28:09.970055+0000","last_peered":"2024-08-17T02:28:09.970055+0000","last_clean":"2024-08-17T02:28:09.970055+0000","last_became_active":"2024-08-17T02:28:08.958336+0000","last_became_peered":"2024-08-17T02:28:08.958336+0000","last_unstale":"2024-08-17T02:28:09.970055+0000","last_undegraded":"2024-08-17T02:28:09.970055+0000","last_fullsized":"2024-08-17T02:28:09.970055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:30.427727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.966017+0000","last_change":"2024-08-17T02:28:09.966017+0000","last_active":"2024-08-17T02:28:09.966017+0000","last_peered":"2024-08-17T02:28:09.966017+0000","last_clean":"2024-08-17T02:28:09.966017+0000","last_became_active":"2024-08-17T02:28:09.965718+0000","last_became_peered":"2024-08-17T02:28:09.965718+0000","last_unstale":"2024-08-17T02:28:09.966017+0000","last_undegraded":"2024-08-17T02:28:09.966017+0000","last_fullsized":"2024-08-17T02:28:09.966017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:34.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970080+0000","last_change":"2024-08-17T02:28:08.963481+0000","last_active":"2024-08-17T02:28:09.970080+0000","last_peered":"2024-08-17T02:28:09.970080+0000","last_clean":"2024-08-17T02:28:09.970080+0000","last_became_active":"2024-08-17T02:28:08.962946+0000","last_became_peered":"2024-08-17T02:28:08.962946+0000","last_unstale":"2024-08-17T02:28:09.970080+0000","last_undegraded":"2024-08-17T02:28:09.970080+0000","last_fullsized":"2024-08-17T02:28:09.970080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:01.615127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968813+0000","last_change":"2024-08-17T02:28:09.964329+0000","last_active":"2024-08-17T02:28:09.968813+0000","last_peered":"2024-08-17T02:28:09.968813+0000","last_clean":"2024-08-17T02:28:09.968813+0000","last_became_active":"2024-08-17T02:28:09.964071+0000","last_became_peered":"2024-08-17T02:28:09.964071+0000","last_unstale":"2024-08-17T02:28:09.968813+0000","last_undegraded":"2024-08-17T02:28:09.968813+0000","last_fullsized":"2024-08-17T02:28:09.968813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:16.787053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.945402+0000","last_change":"2024-08-17T02:28:08.964014+0000","last_active":"2024-08-17T02:28:09.945402+0000","last_peered":"2024-08-17T02:28:09.945402+0000","last_clean":"2024-08-17T02:28:09.945402+0000","last_became_active":"2024-08-17T02:28:08.963331+0000","last_became_peered":"2024-08-17T02:28:08.963331+0000","last_unstale":"2024-08-17T02:28:09.945402+0000","last_undegraded":"2024-08-17T02:28:09.945402+0000","last_fullsized":"2024-08-17T02:28:09.945402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:46.647793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.957520+0000","last_change":"2024-08-17T02:28:09.957520+0000","last_active":"2024-08-17T02:28:09.957520+0000","last_peered":"2024-08-17T02:28:09.957520+0000","last_clean":"2024-08-17T02:28:09.957520+0000","last_became_active":"2024-08-17T02:28:09.956760+0000","last_became_peered":"2024-08-17T02:28:09.956760+0000","last_unstale":"2024-08-17T02:28:09.957520+0000","last_undegraded":"2024-08-17T02:28:09.957520+0000","last_fullsized":"2024-08-17T02:28:09.957520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:52.813679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.943761+0000","last_change":"2024-08-17T02:28:08.964239+0000","last_active":"2024-08-17T02:28:09.943761+0000","last_peered":"2024-08-17T02:28:09.943761+0000","last_clean":"2024-08-17T02:28:09.943761+0000","last_became_active":"2024-08-17T02:28:08.963868+0000","last_became_peered":"2024-08-17T02:28:08.963868+0000","last_unstale":"2024-08-17T02:28:09.943761+0000","last_undegraded":"2024-08-17T02:28:09.943761+0000","last_fullsized":"2024-08-17T02:28:09.943761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:01.615127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959538+0000","last_change":"2024-08-17T02:28:09.958951+0000","last_active":"2024-08-17T02:28:09.959538+0000","last_peered":"2024-08-17T02:28:09.959538+0000","last_clean":"2024-08-17T02:28:09.959538+0000","last_became_active":"2024-08-17T02:28:09.958653+0000","last_became_peered":"2024-08-17T02:28:09.958653+0000","last_unstale":"2024-08-17T02:28:09.959538+0000","last_undegraded":"2024-08-17T02:28:09.959538+0000","last_fullsized":"2024-08-17T02:28:09.959538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:35.703904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.943081+0000","last_change":"2024-08-17T02:28:08.961839+0000","last_active":"2024-08-17T02:28:09.943081+0000","last_peered":"2024-08-17T02:28:09.943081+0000","last_clean":"2024-08-17T02:28:09.943081+0000","last_became_active":"2024-08-17T02:28:08.961243+0000","last_became_peered":"2024-08-17T02:28:08.961243+0000","last_unstale":"2024-08-17T02:28:09.943081+0000","last_undegraded":"2024-08-17T02:28:09.943081+0000","last_fullsized":"2024-08-17T02:28:09.943081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:36:26.816967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968844+0000","last_change":"2024-08-17T02:28:09.968844+0000","last_active":"2024-08-17T02:28:09.968844+0000","last_peered":"2024-08-17T02:28:09.968844+0000","last_clean":"2024-08-17T02:28:09.968844+0000","last_became_active":"2024-08-17T02:28:09.968511+0000","last_became_peered":"2024-08-17T02:28:09.968511+0000","last_unstale":"2024-08-17T02:28:09.968844+0000","last_undegraded":"2024-08-17T02:28:09.968844+0000","last_fullsized":"2024-08-17T02:28:09.968844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:36.354574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963236+0000","last_change":"2024-08-17T02:28:08.959613+0000","last_active":"2024-08-17T02:28:08.963236+0000","last_peered":"2024-08-17T02:28:08.963236+0000","last_clean":"2024-08-17T02:28:08.963236+0000","last_became_active":"2024-08-17T02:28:08.956566+0000","last_became_peered":"2024-08-17T02:28:08.956566+0000","last_unstale":"2024-08-17T02:28:08.963236+0000","last_undegraded":"2024-08-17T02:28:08.963236+0000","last_fullsized":"2024-08-17T02:28:08.963236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:31.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972246+0000","last_change":"2024-08-17T02:28:09.968478+0000","last_active":"2024-08-17T02:28:09.972246+0000","last_peered":"2024-08-17T02:28:09.972246+0000","last_clean":"2024-08-17T02:28:09.972246+0000","last_became_active":"2024-08-17T02:28:09.967938+0000","last_became_peered":"2024-08-17T02:28:09.967938+0000","last_unstale":"2024-08-17T02:28:09.972246+0000","last_undegraded":"2024-08-17T02:28:09.972246+0000","last_fullsized":"2024-08-17T02:28:09.972246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:25:13.866420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.959927+0000","last_change":"2024-08-17T02:28:08.958031+0000","last_active":"2024-08-17T02:28:08.959927+0000","last_peered":"2024-08-17T02:28:08.959927+0000","last_clean":"2024-08-17T02:28:08.959927+0000","last_became_active":"2024-08-17T02:28:08.957749+0000","last_became_peered":"2024-08-17T02:28:08.957749+0000","last_unstale":"2024-08-17T02:28:08.959927+0000","last_undegraded":"2024-08-17T02:28:08.959927+0000","last_fullsized":"2024-08-17T02:28:08.959927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:32.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972297+0000","last_change":"2024-08-17T02:28:09.972297+0000","last_active":"2024-08-17T02:28:09.972297+0000","last_peered":"2024-08-17T02:28:09.972297+0000","last_clean":"2024-08-17T02:28:09.972297+0000","last_became_active":"2024-08-17T02:28:09.972041+0000","last_became_peered":"2024-08-17T02:28:09.972041+0000","last_unstale":"2024-08-17T02:28:09.972297+0000","last_undegraded":"2024-08-17T02:28:09.972297+0000","last_fullsized":"2024-08-17T02:28:09.972297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962728+0000","last_change":"2024-08-17T02:28:08.961571+0000","last_active":"2024-08-17T02:28:08.962728+0000","last_peered":"2024-08-17T02:28:08.962728+0000","last_clean":"2024-08-17T02:28:08.962728+0000","last_became_active":"2024-08-17T02:28:08.960744+0000","last_became_peered":"2024-08-17T02:28:08.960744+0000","last_unstale":"2024-08-17T02:28:08.962728+0000","last_undegraded":"2024-08-17T02:28:08.962728+0000","last_fullsized":"2024-08-17T02:28:08.962728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:05.206197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962947+0000","last_change":"2024-08-17T02:28:09.962947+0000","last_active":"2024-08-17T02:28:09.962947+0000","last_peered":"2024-08-17T02:28:09.962947+0000","last_clean":"2024-08-17T02:28:09.962947+0000","last_became_active":"2024-08-17T02:28:09.962161+0000","last_became_peered":"2024-08-17T02:28:09.962161+0000","last_unstale":"2024-08-17T02:28:09.962947+0000","last_undegraded":"2024-08-17T02:28:09.962947+0000","last_fullsized":"2024-08-17T02:28:09.962947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970564+0000","last_change":"2024-08-17T02:28:08.958285+0000","last_active":"2024-08-17T02:28:09.970564+0000","last_peered":"2024-08-17T02:28:09.970564+0000","last_clean":"2024-08-17T02:28:09.970564+0000","last_became_active":"2024-08-17T02:28:08.957805+0000","last_became_peered":"2024-08-17T02:28:08.957805+0000","last_unstale":"2024-08-17T02:28:09.970564+0000","last_undegraded":"2024-08-17T02:28:09.970564+0000","last_fullsized":"2024-08-17T02:28:09.970564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:27.260237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972646+0000","last_change":"2024-08-17T02:28:09.968705+0000","last_active":"2024-08-17T02:28:09.972646+0000","last_peered":"2024-08-17T02:28:09.972646+0000","last_clean":"2024-08-17T02:28:09.972646+0000","last_became_active":"2024-08-17T02:28:09.968213+0000","last_became_peered":"2024-08-17T02:28:09.968213+0000","last_unstale":"2024-08-17T02:28:09.972646+0000","last_undegraded":"2024-08-17T02:28:09.972646+0000","last_fullsized":"2024-08-17T02:28:09.972646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:16.582318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972052+0000","last_change":"2024-08-17T02:28:08.962503+0000","last_active":"2024-08-17T02:28:09.972052+0000","last_peered":"2024-08-17T02:28:09.972052+0000","last_clean":"2024-08-17T02:28:09.972052+0000","last_became_active":"2024-08-17T02:28:08.961977+0000","last_became_peered":"2024-08-17T02:28:08.961977+0000","last_unstale":"2024-08-17T02:28:09.972052+0000","last_undegraded":"2024-08-17T02:28:09.972052+0000","last_fullsized":"2024-08-17T02:28:09.972052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:15.783042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.959302+0000","last_change":"2024-08-17T02:28:09.959302+0000","last_active":"2024-08-17T02:28:09.959302+0000","last_peered":"2024-08-17T02:28:09.959302+0000","last_clean":"2024-08-17T02:28:09.959302+0000","last_became_active":"2024-08-17T02:28:09.958974+0000","last_became_peered":"2024-08-17T02:28:09.958974+0000","last_unstale":"2024-08-17T02:28:09.959302+0000","last_undegraded":"2024-08-17T02:28:09.959302+0000","last_fullsized":"2024-08-17T02:28:09.959302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:59.676456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971831+0000","last_change":"2024-08-17T02:28:08.961908+0000","last_active":"2024-08-17T02:28:09.971831+0000","last_peered":"2024-08-17T02:28:09.971831+0000","last_clean":"2024-08-17T02:28:09.971831+0000","last_became_active":"2024-08-17T02:28:08.960602+0000","last_became_peered":"2024-08-17T02:28:08.960602+0000","last_unstale":"2024-08-17T02:28:09.971831+0000","last_undegraded":"2024-08-17T02:28:09.971831+0000","last_fullsized":"2024-08-17T02:28:09.971831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:32.891014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968816+0000","last_change":"2024-08-17T02:28:09.968816+0000","last_active":"2024-08-17T02:28:09.968816+0000","last_peered":"2024-08-17T02:28:09.968816+0000","last_clean":"2024-08-17T02:28:09.968816+0000","last_became_active":"2024-08-17T02:28:09.966679+0000","last_became_peered":"2024-08-17T02:28:09.966679+0000","last_unstale":"2024-08-17T02:28:09.968816+0000","last_undegraded":"2024-08-17T02:28:09.968816+0000","last_fullsized":"2024-08-17T02:28:09.968816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:59.646807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962550+0000","last_change":"2024-08-17T02:28:08.960009+0000","last_active":"2024-08-17T02:28:08.962550+0000","last_peered":"2024-08-17T02:28:08.962550+0000","last_clean":"2024-08-17T02:28:08.962550+0000","last_became_active":"2024-08-17T02:28:08.959434+0000","last_became_peered":"2024-08-17T02:28:08.959434+0000","last_unstale":"2024-08-17T02:28:08.962550+0000","last_undegraded":"2024-08-17T02:28:08.962550+0000","last_fullsized":"2024-08-17T02:28:08.962550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:52.212717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.960627+0000","last_change":"2024-08-17T02:28:09.960627+0000","last_active":"2024-08-17T02:28:09.960627+0000","last_peered":"2024-08-17T02:28:09.960627+0000","last_clean":"2024-08-17T02:28:09.960627+0000","last_became_active":"2024-08-17T02:28:09.960357+0000","last_became_peered":"2024-08-17T02:28:09.960357+0000","last_unstale":"2024-08-17T02:28:09.960627+0000","last_undegraded":"2024-08-17T02:28:09.960627+0000","last_fullsized":"2024-08-17T02:28:09.960627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:33.431330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.956199+0000","last_change":"2024-08-17T02:28:08.954434+0000","last_active":"2024-08-17T02:28:08.956199+0000","last_peered":"2024-08-17T02:28:08.956199+0000","last_clean":"2024-08-17T02:28:08.956199+0000","last_became_active":"2024-08-17T02:28:08.953939+0000","last_became_peered":"2024-08-17T02:28:08.953939+0000","last_unstale":"2024-08-17T02:28:08.956199+0000","last_undegraded":"2024-08-17T02:28:08.956199+0000","last_fullsized":"2024-08-17T02:28:08.956199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:25.981859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970682+0000","last_change":"2024-08-17T02:28:09.962552+0000","last_active":"2024-08-17T02:28:09.970682+0000","last_peered":"2024-08-17T02:28:09.970682+0000","last_clean":"2024-08-17T02:28:09.970682+0000","last_became_active":"2024-08-17T02:28:09.962274+0000","last_became_peered":"2024-08-17T02:28:09.962274+0000","last_unstale":"2024-08-17T02:28:09.970682+0000","last_undegraded":"2024-08-17T02:28:09.970682+0000","last_fullsized":"2024-08-17T02:28:09.970682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:51.114341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971457+0000","last_change":"2024-08-17T02:28:08.958232+0000","last_active":"2024-08-17T02:28:09.971457+0000","last_peered":"2024-08-17T02:28:09.971457+0000","last_clean":"2024-08-17T02:28:09.971457+0000","last_became_active":"2024-08-17T02:28:08.957928+0000","last_became_peered":"2024-08-17T02:28:08.957928+0000","last_unstale":"2024-08-17T02:28:09.971457+0000","last_undegraded":"2024-08-17T02:28:09.971457+0000","last_fullsized":"2024-08-17T02:28:09.971457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:45.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972209+0000","last_change":"2024-08-17T02:28:09.968305+0000","last_active":"2024-08-17T02:28:09.972209+0000","last_peered":"2024-08-17T02:28:09.972209+0000","last_clean":"2024-08-17T02:28:09.972209+0000","last_became_active":"2024-08-17T02:28:09.967584+0000","last_became_peered":"2024-08-17T02:28:09.967584+0000","last_unstale":"2024-08-17T02:28:09.972209+0000","last_undegraded":"2024-08-17T02:28:09.972209+0000","last_fullsized":"2024-08-17T02:28:09.972209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:14.651454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.964779+0000","last_change":"2024-08-17T02:28:08.954399+0000","last_active":"2024-08-17T02:28:09.964779+0000","last_peered":"2024-08-17T02:28:09.964779+0000","last_clean":"2024-08-17T02:28:09.964779+0000","last_became_active":"2024-08-17T02:28:08.954083+0000","last_became_peered":"2024-08-17T02:28:08.954083+0000","last_unstale":"2024-08-17T02:28:09.964779+0000","last_undegraded":"2024-08-17T02:28:09.964779+0000","last_fullsized":"2024-08-17T02:28:09.964779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:31.445203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968839+0000","last_change":"2024-08-17T02:28:09.965481+0000","last_active":"2024-08-17T02:28:09.968839+0000","last_peered":"2024-08-17T02:28:09.968839+0000","last_clean":"2024-08-17T02:28:09.968839+0000","last_became_active":"2024-08-17T02:28:09.965107+0000","last_became_peered":"2024-08-17T02:28:09.965107+0000","last_unstale":"2024-08-17T02:28:09.968839+0000","last_undegraded":"2024-08-17T02:28:09.968839+0000","last_fullsized":"2024-08-17T02:28:09.968839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:39:16.275692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971938+0000","last_change":"2024-08-17T02:28:08.962297+0000","last_active":"2024-08-17T02:28:09.971938+0000","last_peered":"2024-08-17T02:28:09.971938+0000","last_clean":"2024-08-17T02:28:09.971938+0000","last_became_active":"2024-08-17T02:28:08.960613+0000","last_became_peered":"2024-08-17T02:28:08.960613+0000","last_unstale":"2024-08-17T02:28:09.971938+0000","last_undegraded":"2024-08-17T02:28:09.971938+0000","last_fullsized":"2024-08-17T02:28:09.971938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:58.028118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970165+0000","last_change":"2024-08-17T02:28:09.970165+0000","last_active":"2024-08-17T02:28:09.970165+0000","last_peered":"2024-08-17T02:28:09.970165+0000","last_clean":"2024-08-17T02:28:09.970165+0000","last_became_active":"2024-08-17T02:28:09.969824+0000","last_became_peered":"2024-08-17T02:28:09.969824+0000","last_unstale":"2024-08-17T02:28:09.970165+0000","last_undegraded":"2024-08-17T02:28:09.970165+0000","last_fullsized":"2024-08-17T02:28:09.970165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:42.748549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.972722+0000","last_change":"2024-08-17T02:28:08.955830+0000","last_active":"2024-08-17T02:28:09.972722+0000","last_peered":"2024-08-17T02:28:09.972722+0000","last_clean":"2024-08-17T02:28:09.972722+0000","last_became_active":"2024-08-17T02:28:08.955564+0000","last_became_peered":"2024-08-17T02:28:08.955564+0000","last_unstale":"2024-08-17T02:28:09.972722+0000","last_undegraded":"2024-08-17T02:28:09.972722+0000","last_fullsized":"2024-08-17T02:28:09.972722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:02:01.196580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962848+0000","last_change":"2024-08-17T02:28:09.956208+0000","last_active":"2024-08-17T02:28:09.962848+0000","last_peered":"2024-08-17T02:28:09.962848+0000","last_clean":"2024-08-17T02:28:09.962848+0000","last_became_active":"2024-08-17T02:28:09.955600+0000","last_became_peered":"2024-08-17T02:28:09.955600+0000","last_unstale":"2024-08-17T02:28:09.962848+0000","last_undegraded":"2024-08-17T02:28:09.962848+0000","last_fullsized":"2024-08-17T02:28:09.962848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:02.619138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.958481+0000","last_change":"2024-08-17T02:28:08.954720+0000","last_active":"2024-08-17T02:28:08.958481+0000","last_peered":"2024-08-17T02:28:08.958481+0000","last_clean":"2024-08-17T02:28:08.958481+0000","last_became_active":"2024-08-17T02:28:08.954475+0000","last_became_peered":"2024-08-17T02:28:08.954475+0000","last_unstale":"2024-08-17T02:28:08.958481+0000","last_undegraded":"2024-08-17T02:28:08.958481+0000","last_fullsized":"2024-08-17T02:28:08.958481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:31.217993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963176+0000","last_change":"2024-08-17T02:28:09.963176+0000","last_active":"2024-08-17T02:28:09.963176+0000","last_peered":"2024-08-17T02:28:09.963176+0000","last_clean":"2024-08-17T02:28:09.963176+0000","last_became_active":"2024-08-17T02:28:09.962858+0000","last_became_peered":"2024-08-17T02:28:09.962858+0000","last_unstale":"2024-08-17T02:28:09.963176+0000","last_undegraded":"2024-08-17T02:28:09.963176+0000","last_fullsized":"2024-08-17T02:28:09.963176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:36.900863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971628+0000","last_change":"2024-08-17T02:28:08.956063+0000","last_active":"2024-08-17T02:28:09.971628+0000","last_peered":"2024-08-17T02:28:09.971628+0000","last_clean":"2024-08-17T02:28:09.971628+0000","last_became_active":"2024-08-17T02:28:08.955378+0000","last_became_peered":"2024-08-17T02:28:08.955378+0000","last_unstale":"2024-08-17T02:28:09.971628+0000","last_undegraded":"2024-08-17T02:28:09.971628+0000","last_fullsized":"2024-08-17T02:28:09.971628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:59.157058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.962154+0000","last_change":"2024-08-17T02:28:09.962154+0000","last_active":"2024-08-17T02:28:09.962154+0000","last_peered":"2024-08-17T02:28:09.962154+0000","last_clean":"2024-08-17T02:28:09.962154+0000","last_became_active":"2024-08-17T02:28:09.961866+0000","last_became_peered":"2024-08-17T02:28:09.961866+0000","last_unstale":"2024-08-17T02:28:09.962154+0000","last_undegraded":"2024-08-17T02:28:09.962154+0000","last_fullsized":"2024-08-17T02:28:09.962154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:01.937775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.964352+0000","last_change":"2024-08-17T02:28:08.961739+0000","last_active":"2024-08-17T02:28:08.964352+0000","last_peered":"2024-08-17T02:28:08.964352+0000","last_clean":"2024-08-17T02:28:08.964352+0000","last_became_active":"2024-08-17T02:28:08.961004+0000","last_became_peered":"2024-08-17T02:28:08.961004+0000","last_unstale":"2024-08-17T02:28:08.964352+0000","last_undegraded":"2024-08-17T02:28:08.964352+0000","last_fullsized":"2024-08-17T02:28:08.964352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:25.981859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.967327+0000","last_change":"2024-08-17T02:28:09.967327+0000","last_active":"2024-08-17T02:28:09.967327+0000","last_peered":"2024-08-17T02:28:09.967327+0000","last_clean":"2024-08-17T02:28:09.967327+0000","last_became_active":"2024-08-17T02:28:09.967033+0000","last_became_peered":"2024-08-17T02:28:09.967033+0000","last_unstale":"2024-08-17T02:28:09.967327+0000","last_undegraded":"2024-08-17T02:28:09.967327+0000","last_fullsized":"2024-08-17T02:28:09.967327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:23:52.187109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.951125+0000","last_change":"2024-08-17T02:28:08.957518+0000","last_active":"2024-08-17T02:28:09.951125+0000","last_peered":"2024-08-17T02:28:09.951125+0000","last_clean":"2024-08-17T02:28:09.951125+0000","last_became_active":"2024-08-17T02:28:08.957171+0000","last_became_peered":"2024-08-17T02:28:08.957171+0000","last_unstale":"2024-08-17T02:28:09.951125+0000","last_undegraded":"2024-08-17T02:28:09.951125+0000","last_fullsized":"2024-08-17T02:28:09.951125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:45.128390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.958751+0000","last_change":"2024-08-17T02:28:09.957820+0000","last_active":"2024-08-17T02:28:09.958751+0000","last_peered":"2024-08-17T02:28:09.958751+0000","last_clean":"2024-08-17T02:28:09.958751+0000","last_became_active":"2024-08-17T02:28:09.957551+0000","last_became_peered":"2024-08-17T02:28:09.957551+0000","last_unstale":"2024-08-17T02:28:09.958751+0000","last_undegraded":"2024-08-17T02:28:09.958751+0000","last_fullsized":"2024-08-17T02:28:09.958751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:03.502209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.950382+0000","last_change":"2024-08-17T02:28:08.955027+0000","last_active":"2024-08-17T02:28:09.950382+0000","last_peered":"2024-08-17T02:28:09.950382+0000","last_clean":"2024-08-17T02:28:09.950382+0000","last_became_active":"2024-08-17T02:28:08.954761+0000","last_became_peered":"2024-08-17T02:28:08.954761+0000","last_unstale":"2024-08-17T02:28:09.950382+0000","last_undegraded":"2024-08-17T02:28:09.950382+0000","last_fullsized":"2024-08-17T02:28:09.950382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:38:33.681787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963529+0000","last_change":"2024-08-17T02:28:09.958642+0000","last_active":"2024-08-17T02:28:09.963529+0000","last_peered":"2024-08-17T02:28:09.963529+0000","last_clean":"2024-08-17T02:28:09.963529+0000","last_became_active":"2024-08-17T02:28:09.958368+0000","last_became_peered":"2024-08-17T02:28:09.958368+0000","last_unstale":"2024-08-17T02:28:09.963529+0000","last_undegraded":"2024-08-17T02:28:09.963529+0000","last_fullsized":"2024-08-17T02:28:09.963529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:59.032129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.968401+0000","last_change":"2024-08-17T02:28:08.960858+0000","last_active":"2024-08-17T02:28:09.968401+0000","last_peered":"2024-08-17T02:28:09.968401+0000","last_clean":"2024-08-17T02:28:09.968401+0000","last_became_active":"2024-08-17T02:28:08.960504+0000","last_became_peered":"2024-08-17T02:28:08.960504+0000","last_unstale":"2024-08-17T02:28:09.968401+0000","last_undegraded":"2024-08-17T02:28:09.968401+0000","last_fullsized":"2024-08-17T02:28:09.968401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:33.179500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.971007+0000","last_change":"2024-08-17T02:28:09.963866+0000","last_active":"2024-08-17T02:28:09.971007+0000","last_peered":"2024-08-17T02:28:09.971007+0000","last_clean":"2024-08-17T02:28:09.971007+0000","last_became_active":"2024-08-17T02:28:09.963606+0000","last_became_peered":"2024-08-17T02:28:09.963606+0000","last_unstale":"2024-08-17T02:28:09.971007+0000","last_undegraded":"2024-08-17T02:28:09.971007+0000","last_fullsized":"2024-08-17T02:28:09.971007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:55:39.156678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.959799+0000","last_change":"2024-08-17T02:28:08.957006+0000","last_active":"2024-08-17T02:28:08.959799+0000","last_peered":"2024-08-17T02:28:08.959799+0000","last_clean":"2024-08-17T02:28:08.959799+0000","last_became_active":"2024-08-17T02:28:08.956682+0000","last_became_peered":"2024-08-17T02:28:08.956682+0000","last_unstale":"2024-08-17T02:28:08.959799+0000","last_undegraded":"2024-08-17T02:28:08.959799+0000","last_fullsized":"2024-08-17T02:28:08.959799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:59.050167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.953755+0000","last_change":"2024-08-17T02:28:09.952413+0000","last_active":"2024-08-17T02:28:09.953755+0000","last_peered":"2024-08-17T02:28:09.953755+0000","last_clean":"2024-08-17T02:28:09.953755+0000","last_became_active":"2024-08-17T02:28:09.952012+0000","last_became_peered":"2024-08-17T02:28:09.952012+0000","last_unstale":"2024-08-17T02:28:09.953755+0000","last_undegraded":"2024-08-17T02:28:09.953755+0000","last_fullsized":"2024-08-17T02:28:09.953755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:26.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963384+0000","last_change":"2024-08-17T02:28:08.961340+0000","last_active":"2024-08-17T02:28:08.963384+0000","last_peered":"2024-08-17T02:28:08.963384+0000","last_clean":"2024-08-17T02:28:08.963384+0000","last_became_active":"2024-08-17T02:28:08.960305+0000","last_became_peered":"2024-08-17T02:28:08.960305+0000","last_unstale":"2024-08-17T02:28:08.963384+0000","last_undegraded":"2024-08-17T02:28:08.963384+0000","last_fullsized":"2024-08-17T02:28:08.963384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:02.498198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965539+0000","last_change":"2024-08-17T02:28:09.965539+0000","last_active":"2024-08-17T02:28:09.965539+0000","last_peered":"2024-08-17T02:28:09.965539+0000","last_clean":"2024-08-17T02:28:09.965539+0000","last_became_active":"2024-08-17T02:28:09.964917+0000","last_became_peered":"2024-08-17T02:28:09.964917+0000","last_unstale":"2024-08-17T02:28:09.965539+0000","last_undegraded":"2024-08-17T02:28:09.965539+0000","last_fullsized":"2024-08-17T02:28:09.965539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:23:41.338655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.963288+0000","last_change":"2024-08-17T02:28:08.962183+0000","last_active":"2024-08-17T02:28:08.963288+0000","last_peered":"2024-08-17T02:28:08.963288+0000","last_clean":"2024-08-17T02:28:08.963288+0000","last_became_active":"2024-08-17T02:28:08.960909+0000","last_became_peered":"2024-08-17T02:28:08.960909+0000","last_unstale":"2024-08-17T02:28:08.963288+0000","last_undegraded":"2024-08-17T02:28:08.963288+0000","last_fullsized":"2024-08-17T02:28:08.963288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:34.699893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.963034+0000","last_change":"2024-08-17T02:28:09.963034+0000","last_active":"2024-08-17T02:28:09.963034+0000","last_peered":"2024-08-17T02:28:09.963034+0000","last_clean":"2024-08-17T02:28:09.963034+0000","last_became_active":"2024-08-17T02:28:09.962772+0000","last_became_peered":"2024-08-17T02:28:09.962772+0000","last_unstale":"2024-08-17T02:28:09.963034+0000","last_undegraded":"2024-08-17T02:28:09.963034+0000","last_fullsized":"2024-08-17T02:28:09.963034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:56:17.045087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.962723+0000","last_change":"2024-08-17T02:28:08.960666+0000","last_active":"2024-08-17T02:28:08.962723+0000","last_peered":"2024-08-17T02:28:08.962723+0000","last_clean":"2024-08-17T02:28:08.962723+0000","last_became_active":"2024-08-17T02:28:08.960357+0000","last_became_peered":"2024-08-17T02:28:08.960357+0000","last_unstale":"2024-08-17T02:28:08.962723+0000","last_undegraded":"2024-08-17T02:28:08.962723+0000","last_fullsized":"2024-08-17T02:28:08.962723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:44.526453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.960250+0000","last_change":"2024-08-17T02:28:09.960250+0000","last_active":"2024-08-17T02:28:09.960250+0000","last_peered":"2024-08-17T02:28:09.960250+0000","last_clean":"2024-08-17T02:28:09.960250+0000","last_became_active":"2024-08-17T02:28:09.958564+0000","last_became_peered":"2024-08-17T02:28:09.958564+0000","last_unstale":"2024-08-17T02:28:09.960250+0000","last_undegraded":"2024-08-17T02:28:09.960250+0000","last_fullsized":"2024-08-17T02:28:09.960250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:28.264248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.964237+0000","last_change":"2024-08-17T02:28:08.961782+0000","last_active":"2024-08-17T02:28:08.964237+0000","last_peered":"2024-08-17T02:28:08.964237+0000","last_clean":"2024-08-17T02:28:08.964237+0000","last_became_active":"2024-08-17T02:28:08.961138+0000","last_became_peered":"2024-08-17T02:28:08.961138+0000","last_unstale":"2024-08-17T02:28:08.964237+0000","last_undegraded":"2024-08-17T02:28:08.964237+0000","last_fullsized":"2024-08-17T02:28:08.964237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:52.212717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.970292+0000","last_change":"2024-08-17T02:28:09.958792+0000","last_active":"2024-08-17T02:28:09.970292+0000","last_peered":"2024-08-17T02:28:09.970292+0000","last_clean":"2024-08-17T02:28:09.970292+0000","last_became_active":"2024-08-17T02:28:09.956528+0000","last_became_peered":"2024-08-17T02:28:09.956528+0000","last_unstale":"2024-08-17T02:28:09.970292+0000","last_undegraded":"2024-08-17T02:28:09.970292+0000","last_fullsized":"2024-08-17T02:28:09.970292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:24.244682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:28:08.958482+0000","last_change":"2024-08-17T02:28:08.957335+0000","last_active":"2024-08-17T02:28:08.958482+0000","last_peered":"2024-08-17T02:28:08.958482+0000","last_clean":"2024-08-17T02:28:08.958482+0000","last_became_active":"2024-08-17T02:28:08.956749+0000","last_became_peered":"2024-08-17T02:28:08.956749+0000","last_unstale":"2024-08-17T02:28:08.958482+0000","last_undegraded":"2024-08-17T02:28:08.958482+0000","last_fullsized":"2024-08-17T02:28:08.958482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:58.028118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.965420+0000","last_change":"2024-08-17T02:28:09.965420+0000","last_active":"2024-08-17T02:28:09.965420+0000","last_peered":"2024-08-17T02:28:09.965420+0000","last_clean":"2024-08-17T02:28:09.965420+0000","last_became_active":"2024-08-17T02:28:09.965017+0000","last_became_peered":"2024-08-17T02:28:09.965017+0000","last_unstale":"2024-08-17T02:28:09.965420+0000","last_undegraded":"2024-08-17T02:28:09.965420+0000","last_fullsized":"2024-08-17T02:28:09.965420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:08.926086+0000","last_clean_scrub_stamp":"2024-08-17T02:28:08.926086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:39.849587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.954969+0000","last_change":"2024-08-17T02:28:08.955290+0000","last_active":"2024-08-17T02:28:09.954969+0000","last_peered":"2024-08-17T02:28:09.954969+0000","last_clean":"2024-08-17T02:28:09.954969+0000","last_became_active":"2024-08-17T02:28:08.955012+0000","last_became_peered":"2024-08-17T02:28:08.955012+0000","last_unstale":"2024-08-17T02:28:09.954969+0000","last_undegraded":"2024-08-17T02:28:09.954969+0000","last_fullsized":"2024-08-17T02:28:09.954969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:07.922075+0000","last_clean_scrub_stamp":"2024-08-17T02:28:07.922075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:05.267667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:09.949134+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:28:09.949134+0000","last_peered":"2024-08-17T02:28:09.949134+0000","last_clean":"2024-08-17T02:28:09.949134+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:28:09.949134+0000","last_undegraded":"2024-08-17T02:28:09.949134+0000","last_fullsized":"2024-08-17T02:28:09.949134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":130591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":356352,"data_stored":132121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":937984,"data_stored":720496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":132143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":131333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":348160,"data_stored":130603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":942080,"data_stored":721007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301856,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069984,"statfs":{"total":96636764160,"available":96327663616,"internally_reserved":0,"allocated":348160,"data_stored":130659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:13.839 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:28:13.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:28:13.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.952+0000 7f7cd285c700 1 Processor -- start 2024-08-17T02:28:13.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.952+0000 7f7cd285c700 1 -- start start 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 0x7f7ccc0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc06d2f0 0x7f7ccc06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc06dcb0 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc15dcd0 con 0x7f7ccc150380 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd285c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc15ce20 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44914/0 (socket says 172.21.15.155:44914) 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 -- 172.21.15.155:0/2073817640 learned_addr learned my addr 172.21.15.155:0/2073817640 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccb7fe700 1 --2- 172.21.15.155:0/2073817640 >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 0x7f7ccc0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7cd0df9700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc06d2f0 0x7f7ccc06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 -- 172.21.15.155:0/2073817640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc06d2f0 msgr2=0x7f7ccc06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc06d2f0 0x7f7ccc06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 -- 172.21.15.155:0/2073817640 >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 msgr2=0x7f7ccc0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/2073817640 >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 0x7f7ccc0b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 -- 172.21.15.155:0/2073817640 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc15d0c0 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccb7fe700 1 --2- 172.21.15.155:0/2073817640 >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 0x7f7ccc0b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0b06f0 tx=0x7f7cc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfd7ac5371a45b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccaffd700 1 -- 172.21.15.155:0/2073817640 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0009e70 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccaffd700 1 -- 172.21.15.155:0/2073817640 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000b860 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.956+0000 7f7ccaffd700 1 -- 172.21.15.155:0/2073817640 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000bc00 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- 172.21.15.155:0/2073817640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc14ffb0 msgr2=0x7f7ccc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0b06f0 tx=0x7f7cc0009250 comp rx=0 tx=0).stop 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- 172.21.15.155:0/2073817640 shutdown_connections 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc06d2f0 0x7f7ccc06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 --2- 172.21.15.155:0/2073817640 >> v2:172.21.15.189:3300/0 conn(0x7f7ccc150380 0x7f7ccc0b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 --2- 172.21.15.155:0/2073817640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc14ffb0 0x7f7ccc0687a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- 172.21.15.155:0/2073817640 >> 172.21.15.155:0/2073817640 conn(0x7f7ccc0ceae0 msgr2=0x7f7ccc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- 172.21.15.155:0/2073817640 shutdown_connections 2024-08-17T02:28:13.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- 172.21.15.155:0/2073817640 wait complete. 2024-08-17T02:28:13.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 Processor -- start 2024-08-17T02:28:13.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.960+0000 7f7cd285c700 1 -- start start 2024-08-17T02:28:13.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc14ffb0 0x7f7ccc1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 0x7f7ccc13d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc069df0 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06a0d0 con 0x7f7ccc150380 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06a3b0 con 0x7f7ccc14ffb0 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44930/0 (socket says 172.21.15.155:44930) 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 -- 172.21.15.155:0/1003881863 learned_addr learned my addr 172.21.15.155:0/1003881863 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd0df9700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 0x7f7ccc13d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccb7fe700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc14ffb0 0x7f7ccc1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 -- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc14ffb0 msgr2=0x7f7ccc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc14ffb0 0x7f7ccc1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 -- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 msgr2=0x7f7ccc13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 0x7f7ccc13d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 -- 172.21.15.155:0/1003881863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00094f0 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd0df9700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 0x7f7ccc13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7ccbfff700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009290 tx=0x7f7cc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000bbe0 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc001f070 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc06a690 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00266b0 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc13de70 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.964+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc0645c0 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.968+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7cc0026a60 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.968+0000 7f7cb3fff700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 0x7f7cb8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.968+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cc0021070 con 0x7f7ccc06d2f0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.968+0000 7f7ccb7fe700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 0x7f7cb8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.968+0000 7f7ccb7fe700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 0x7f7cb8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc006f00 tx=0x7f7cbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:13.980+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7cc004ecc0 con 0x7f7ccc06d2f0 2024-08-17T02:28:14.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.196+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7ccc0b0720 con 0x7f7ccc06d2f0 2024-08-17T02:28:14.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.204+0000 7f7cb3fff700 1 -- 172.21.15.155:0/1003881863 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7cc00150e0 con 0x7f7ccc06d2f0 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 msgr2=0x7f7cb8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 0x7f7cb8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc006f00 tx=0x7f7cbc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 msgr2=0x7f7ccc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009290 tx=0x7f7cc0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 shutdown_connections 2024-08-17T02:28:14.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7cb8060860 0x7f7cb8062d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ccc150380 0x7f7ccc13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ccc14ffb0 0x7f7ccc1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 --2- 172.21.15.155:0/1003881863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc06d2f0 0x7f7ccc0697e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 >> 172.21.15.155:0/1003881863 conn(0x7f7ccc0ceae0 msgr2=0x7f7ccc14c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 shutdown_connections 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.208+0000 7f7cd285c700 1 -- 172.21.15.155:0/1003881863 wait complete. 2024-08-17T02:28:14.211 INFO:teuthology.orchestra.run.smithi155.stderr:updated caps for client.0 2024-08-17T02:28:14.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:14.299 INFO:tasks.ceph.mds.a.smithi155.stderr:2024-08-17T02:28:14.296+0000 7fcf6227a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:14.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 Processor -- start 2024-08-17T02:28:14.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 -- start start 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74980b0350 0x7f74980ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 0x7f749806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749806e8b0 con 0x7f7498155d20 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980b07a0 con 0x7f74980b0350 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749e600700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74980af2b0 con 0x7f749806df10 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749cdfd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74980b0350 0x7f74980ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749cdfd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74980b0350 0x7f74980ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44944/0 (socket says 172.21.15.155:44944) 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749cdfd700 1 -- 172.21.15.155:0/2175727645 learned_addr learned my addr 172.21.15.155:0/2175727645 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749d5fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7498155d20 0x7f74980aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35070/0 (socket says 172.21.15.155:35070) 2024-08-17T02:28:14.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.328+0000 7f749ddff700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 0x7f749806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749cdfd700 1 -- 172.21.15.155:0/2175727645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 msgr2=0x7f749806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749cdfd700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 0x7f749806e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749cdfd700 1 -- 172.21.15.155:0/2175727645 >> v1:172.21.15.155:6789/0 conn(0x7f7498155d20 legacy=0x7f74980aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749cdfd700 1 -- 172.21.15.155:0/2175727645 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980af590 con 0x7f74980b0350 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749ddff700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 0x7f749806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f748bfff700 1 -- 172.21.15.155:0/2175727645 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295978110 0 0) 0x7f748c001110 con 0x7f7498155d20 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749cdfd700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74980b0350 0x7f74980ad7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74940099b0 tx=0x7f7494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfec0e24057c3a3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f748bfff700 1 -- 172.21.15.155:0/2175727645 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400b860 con 0x7f74980b0350 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f748bfff700 1 -- 172.21.15.155:0/2175727645 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749400b9c0 con 0x7f74980b0350 2024-08-17T02:28:14.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f748bfff700 1 -- 172.21.15.155:0/2175727645 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400bd60 con 0x7f74980b0350 2024-08-17T02:28:14.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- 172.21.15.155:0/2175727645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74980b0350 msgr2=0x7f74980ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74980b0350 0x7f74980ad7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74940099b0 tx=0x7f7494009250 comp rx=0 tx=0).stop 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- 172.21.15.155:0/2175727645 shutdown_connections 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f749806df10 0x7f749806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- 172.21.15.155:0/2175727645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74980b0350 0x7f74980ad7c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- 172.21.15.155:0/2175727645 >> 172.21.15.155:0/2175727645 conn(0x7f74980678d0 msgr2=0x7f7498067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- 172.21.15.155:0/2175727645 shutdown_connections 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- 172.21.15.155:0/2175727645 wait complete. 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 Processor -- start 2024-08-17T02:28:14.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- start start 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749806df10 0x7f7498149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74980b0350 0x7f749814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749814c9c0 con 0x7f7498155d20 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749814b2b0 con 0x7f749806df10 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749e600700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749814bdb0 con 0x7f74980b0350 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749ddff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749ddff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44960/0 (socket says 172.21.15.155:44960) 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.332+0000 7f749ddff700 1 -- 172.21.15.155:0/4026072380 learned_addr learned my addr 172.21.15.155:0/4026072380 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749cdfd700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74980b0350 0x7f749814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749d5fe700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749806df10 0x7f7498149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 -- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74980b0350 msgr2=0x7f749814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74980b0350 0x7f749814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 -- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749806df10 msgr2=0x7f7498149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749806df10 0x7f7498149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 -- 172.21.15.155:0/4026072380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094f0 con 0x7f7498155d20 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749ddff700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f749000d180 tx=0x7f7490009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000de20 con 0x7f7498155d20 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000f040 con 0x7f7498155d20 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749814b510 con 0x7f7498155d20 2024-08-17T02:28:14.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490015670 con 0x7f7498155d20 2024-08-17T02:28:14.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749814bad0 con 0x7f7498155d20 2024-08-17T02:28:14.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749814cb70 con 0x7f7498155d20 2024-08-17T02:28:14.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.336+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f749001e3b0 con 0x7f7498155d20 2024-08-17T02:28:14.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.340+0000 7f74897fa700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 0x7f747c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.340+0000 7f749d5fe700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 0x7f747c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.340+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f749007d270 con 0x7f7498155d20 2024-08-17T02:28:14.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.340+0000 7f749d5fe700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 0x7f747c062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f748c007fd0 tx=0x7f748c007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.344+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f749814cb70 con 0x7f7498155d20 2024-08-17T02:28:14.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.540+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f749814cb70 con 0x7f7498155d20 2024-08-17T02:28:14.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.540+0000 7f74897fa700 1 -- 172.21.15.155:0/4026072380 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f749814cb70 con 0x7f7498155d20 2024-08-17T02:28:14.545 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:14.545 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4930,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 msgr2=0x7f747c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 0x7f747c062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f748c007fd0 tx=0x7f748c007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 msgr2=0x7f7498147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f749000d180 tx=0x7f7490009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 shutdown_connections 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f747c060860 0x7f747c062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498155d20 0x7f7498147e10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f74980b0350 0x7f749814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 --2- 172.21.15.155:0/4026072380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749806df10 0x7f7498149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 >> 172.21.15.155:0/4026072380 conn(0x7f74980678d0 msgr2=0x7f7498063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 shutdown_connections 2024-08-17T02:28:14.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:14.544+0000 7f749e600700 1 -- 172.21.15.155:0/4026072380 wait complete. 2024-08-17T02:28:14.550 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 14 2024-08-17T02:28:14.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:28:09.299565+0000', 'modified': '2024-08-17T02:28:12.463328+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/2606343357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 2606343357}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 2606343357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:28:14.968 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:28:14.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:28:15.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 Processor -- start 2024-08-17T02:28:15.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 -- start start 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82c0159340 0x7f82c0159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c00b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c00b1cf0 con 0x7f82c0159c50 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c00b60d0 con 0x7f82c0159340 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c75f4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00b10e0 con 0x7f82c00b4330 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82c0159340 0x7f82c0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82c0159340 0x7f82c0159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44974/0 (socket says 172.21.15.155:44974) 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 -- 172.21.15.155:0/1329042619 learned_addr learned my addr 172.21.15.155:0/1329042619 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5b91700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c00b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 -- 172.21.15.155:0/1329042619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 msgr2=0x7f82c00b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c00b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 -- 172.21.15.155:0/1329042619 >> v1:172.21.15.189:6789/0 conn(0x7f82c0159c50 legacy=0x7f82c00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 -- 172.21.15.155:0/1329042619 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00b13c0 con 0x7f82c0159340 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5b91700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c00b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82c5390700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c0159710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f82b00099b0 tx=0x7f82b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9fb1ad681b7b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.080+0000 7f82b7fff700 1 -- 172.21.15.155:0/1329042619 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000b860 con 0x7f82c0159340 2024-08-17T02:28:15.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82b7fff700 1 -- 172.21.15.155:0/1329042619 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b000b9c0 con 0x7f82c0159340 2024-08-17T02:28:15.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82b7fff700 1 -- 172.21.15.155:0/1329042619 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000bd60 con 0x7f82c0159340 2024-08-17T02:28:15.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- 172.21.15.155:0/1329042619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 msgr2=0x7f82c0159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c0159710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f82b00099b0 tx=0x7f82b0009250 comp rx=0 tx=0).stop 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- 172.21.15.155:0/1329042619 shutdown_connections 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c00b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 --2- 172.21.15.155:0/1329042619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c0159710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- 172.21.15.155:0/1329042619 >> 172.21.15.155:0/1329042619 conn(0x7f82c00994f0 msgr2=0x7f82c00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- 172.21.15.155:0/1329042619 shutdown_connections 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- 172.21.15.155:0/1329042619 wait complete. 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 Processor -- start 2024-08-17T02:28:15.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.084+0000 7f82c75f4700 1 -- start start 2024-08-17T02:28:15.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c009caa0 con 0x7f82c0159340 2024-08-17T02:28:15.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0154e00 con 0x7f82c0159c50 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c009b500 con 0x7f82c00b4330 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5390700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44984/0 (socket says 172.21.15.155:44984) 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:58834/0 (socket says 172.21.15.155:58834) 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5390700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c014e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:32940/0 (socket says 172.21.15.155:32940) 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 -- 172.21.15.155:0/2209260849 learned_addr learned my addr 172.21.15.155:0/2209260849 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 -- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 msgr2=0x7f82c014e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c014e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 -- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 msgr2=0x7f82c009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 -- 172.21.15.155:0/2209260849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00094f0 con 0x7f82c0159c50 2024-08-17T02:28:15.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:15.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c5b91700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82b800d150 tx=0x7f82b8009a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82b57fa700 1 -- 172.21.15.155:0/2209260849 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800dc90 con 0x7f82c0159c50 2024-08-17T02:28:15.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82b57fa700 1 -- 172.21.15.155:0/2209260849 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800f040 con 0x7f82c0159c50 2024-08-17T02:28:15.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c0154b80 con 0x7f82c0159c50 2024-08-17T02:28:15.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82b57fa700 1 -- 172.21.15.155:0/2209260849 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8015690 con 0x7f82c0159c50 2024-08-17T02:28:15.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.088+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c009aeb0 con 0x7f82c0159c50 2024-08-17T02:28:15.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82b57fa700 1 -- 172.21.15.155:0/2209260849 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f82b801e3b0 con 0x7f82c0159c50 2024-08-17T02:28:15.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82b57fa700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 0x7f82ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82b57fa700 1 -- 172.21.15.155:0/2209260849 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82b807d080 con 0x7f82c0159c50 2024-08-17T02:28:15.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82c5390700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 0x7f82ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82c98a3740 1 Processor -- start 2024-08-17T02:28:15.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82c5390700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 0x7f82ac062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82b00099b0 tx=0x7f82b0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.092+0000 7f82c98a3740 1 -- start start 2024-08-17T02:28:15.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1adf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a57ba0 con 0x18ab710 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a53b40 con 0x18abae0 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a190a0 con 0x18f6790 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c5390700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1adf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44986/0 (socket says 172.21.15.155:44986) 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 -- 172.21.15.155:0/1102906662 learned_addr learned my addr 172.21.15.155:0/1102906662 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c5b91700 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 -- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 msgr2=0x1ae2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 -- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 msgr2=0x1adf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1adf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 -- 172.21.15.155:0/1102906662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18f79e0 con 0x18ab710 2024-08-17T02:28:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c5b91700 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001a70 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e95ec1e0f2c4a88 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82a67fc700 1 -- 172.21.15.155:0/1102906662 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00f9a0 con 0x18ab710 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82a67fc700 1 -- 172.21.15.155:0/1102906662 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc00fb00 con 0x18ab710 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82a67fc700 1 -- 172.21.15.155:0/1102906662 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00fea0 con 0x18ab710 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- 172.21.15.155:0/1102906662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 msgr2=0x1adf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001a70 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- 172.21.15.155:0/1102906662 shutdown_connections 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1adf710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 --2- 172.21.15.155:0/1102906662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1adf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- 172.21.15.155:0/1102906662 >> 172.21.15.155:0/1102906662 conn(0x18abeb0 msgr2=0x1ae50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- 172.21.15.155:0/1102906662 shutdown_connections 2024-08-17T02:28:15.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- 172.21.15.155:0/1102906662 wait complete. 2024-08-17T02:28:15.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 -- start start 2024-08-17T02:28:15.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.096+0000 7f82c98a3740 1 Processor -- start 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a18d40 con 0x18ab710 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x19f1970 con 0x18abae0 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x19cccb0 con 0x18f6790 2024-08-17T02:28:15.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 10 client.0 _ll_register_callbacks cb 0x19f5f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45002/0 (socket says 172.21.15.155:45002) 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 -- 172.21.15.155:0/3059611543 learned_addr learned my addr 172.21.15.155:0/3059611543 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5b91700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 -- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 msgr2=0x1ae6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 -- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 msgr2=0x1b2cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b2cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 -- 172.21.15.155:0/3059611543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c00b1cf0 con 0x18ab710 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5b91700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c5390700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82c0089140 tx=0x7f82b0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8543a1c2a1559df6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b002c070 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82b001a630 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18b9260 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b0020070 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 10 client.5106 fetch_fsmap learned FSMap version 14 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x1a21370 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18b9260 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f82b001aa00 con 0x18ab710 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 10 client.5106 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:28:15.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 10 client.5106 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 20 client.5106 populate_metadata read hostname 'smithi155' 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b35c30 0x1b38010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 4 client.5106 mds_command: new command op to 4938 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 --> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19034e0 con 0x1b35c30 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.100+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b35c30 0x1b38010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b35c30 0x1b38010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33bab84c804923f9 server_cookie=56b2db4695e993d in_seq=0 out_seq=0 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f829f7fe700 10 client.5106 ms_handle_connect on v2:172.21.15.155:6836/2606343357 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f829f7fe700 1 -- 172.21.15.155:0/3059611543 <== mds.0 v2:172.21.15.155:6836/2606343357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x19034e0 con 0x1b35c30 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f829f7fe700 10 client.5106 handle_command_reply: tid=0 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 client.5106 shutdown 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 msgr2=0x1b2caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82c0089140 tx=0x7f82b0020000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 shutdown_connections 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1ae6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b35c30 0x1b38010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b2cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3059611543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18ab710 0x1b2caa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f829f7fe700 0 client.5106 ms_handle_reset on v2:172.21.15.155:6836/2606343357 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 >> 172.21.15.155:0/3059611543 conn(0x18abeb0 msgr2=0x1ae4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 shutdown_connections 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 1 -- 172.21.15.155:0/3059611543 wait complete. 2024-08-17T02:28:15.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.104+0000 7f82c98a3740 20 client.5106 trim_cache size 0 max 16384 2024-08-17T02:28:15.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 Processor -- start 2024-08-17T02:28:15.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 -- start start 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 0x1ae4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1adde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a51500 con 0x18abae0 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a1d9c0 con 0x18ab710 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4f650 con 0x18f6790 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c4b8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45008/0 (socket says 172.21.15.155:45008) 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c4b8f700 1 -- 172.21.15.155:0/3544362939 learned_addr learned my addr 172.21.15.155:0/3544362939 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c5390700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 0x1ae4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c5b91700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1adde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c4b8f700 1 -- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 msgr2=0x1adde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.124+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1adde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c4b8f700 1 -- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 msgr2=0x1ae4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 0x1ae4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c4b8f700 1 -- 172.21.15.155:0/3544362939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a07d80 con 0x18abae0 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c5390700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 0x1ae4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001850 tx=0x7f82bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2f1a4baa14fb28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82a6ffd700 1 -- 172.21.15.155:0/3544362939 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc026070 con 0x18abae0 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82a6ffd700 1 -- 172.21.15.155:0/3544362939 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc027040 con 0x18abae0 2024-08-17T02:28:15.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82a6ffd700 1 -- 172.21.15.155:0/3544362939 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc02a490 con 0x18abae0 2024-08-17T02:28:15.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- 172.21.15.155:0/3544362939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 msgr2=0x1add930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f82bc001850 tx=0x7f82bc015000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- 172.21.15.155:0/3544362939 shutdown_connections 2024-08-17T02:28:15.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18f6790 0x1adde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18abae0 0x1add930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 --2- 172.21.15.155:0/3544362939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18ab710 0x1ae4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- 172.21.15.155:0/3544362939 >> 172.21.15.155:0/3544362939 conn(0x18abeb0 msgr2=0x1b2b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- 172.21.15.155:0/3544362939 shutdown_connections 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- 172.21.15.155:0/3544362939 wait complete. 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 -- start start 2024-08-17T02:28:15.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.128+0000 7f82c98a3740 1 Processor -- start 2024-08-17T02:28:15.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18ab710 0x1b39420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b40e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x19247c0 con 0x18f6790 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a57640 con 0x18abae0 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a56200 con 0x18ab710 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 10 client.0 _ll_register_callbacks cb 0x18779d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45014/0 (socket says 172.21.15.155:45014) 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 -- 172.21.15.155:0/8375205 learned_addr learned my addr 172.21.15.155:0/8375205 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5390700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18ab710 0x1b39420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b40e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 -- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18ab710 msgr2=0x1b39420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18ab710 0x1b39420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 -- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 msgr2=0x1b40e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b40e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 -- 172.21.15.155:0/8375205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18f79e0 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c4b8f700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b40e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5b91700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82b8051120 tx=0x7f82b8021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fa80b0e8462ea0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b804f2d0 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82b804f530 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82bc00fb00 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b8050890 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 10 client.5112 fetch_fsmap learned FSMap version 14 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x19fc130 con 0x18f6790 2024-08-17T02:28:15.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8079020 con 0x18f6790 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f82b8062bd0 con 0x18f6790 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 10 client.5112 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 10 client.5112 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 20 client.5112 populate_metadata read hostname 'smithi155' 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b842c0 0x1b84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 4 client.5112 mds_command: new command op to 4938 tid=0[{"prefix": "status"}] 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 --> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1928260 con 0x1b842c0 2024-08-17T02:28:15.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5390700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b842c0 0x1b84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 10 client.5112 ms_handle_connect on v2:172.21.15.155:6836/2606343357 2024-08-17T02:28:15.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c5390700 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b842c0 0x1b84690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae2616e9d4c5451 server_cookie=baaeacced8eead84 in_seq=0 out_seq=0 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 1 -- 172.21.15.155:0/8375205 <== mds.0 v2:172.21.15.155:6836/2606343357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1928260 con 0x1b842c0 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 10 client.5112 handle_command_reply: tid=0 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 client.5112 shutdown 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 msgr2=0x1b413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82b8051120 tx=0x7f82b8021040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 shutdown_connections 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x18f6790 0x1b413d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.155:6836/2606343357,v1:172.21.15.155:6837/2606343357] conn(0x1b842c0 0x1b84690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x18abae0 0x1b40e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f829f7fe700 0 client.5112 ms_handle_reset on v2:172.21.15.155:6836/2606343357 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.132+0000 7f82c98a3740 1 --2- 172.21.15.155:0/8375205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x18ab710 0x1b39420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 >> 172.21.15.155:0/8375205 conn(0x18abeb0 msgr2=0x1adf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 shutdown_connections 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c98a3740 1 -- 172.21.15.155:0/8375205 wait complete. 2024-08-17T02:28:15.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c98a3740 20 client.5112 trim_cache size 0 max 16384 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "fa54bf99-d4c6-4ed9-b983-a07e3ced1452", 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4938, 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-08-17T02:28:15.141 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 5.1986065220000004, 2024-08-17T02:28:15.142 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 14, 2024-08-17T02:28:15.142 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 32, 2024-08-17T02:28:15.142 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:28:15.142 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 12.698319786000001 2024-08-17T02:28:15.142 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 msgr2=0x7f82ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 0x7f82ac062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82b00099b0 tx=0x7f82b0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 msgr2=0x7f82c0154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82b800d150 tx=0x7f82b8009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 shutdown_connections 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f82ac060860 0x7f82ac062d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82c0159c50 0x7f82c0154640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c0159340 0x7f82c009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 --2- 172.21.15.155:0/2209260849 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f82c00b4330 0x7f82c014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 >> 172.21.15.155:0/2209260849 conn(0x7f82c00994f0 msgr2=0x7f82c00b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 shutdown_connections 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.136+0000 7f82c75f4700 1 -- 172.21.15.155:0/2209260849 wait complete. 2024-08-17T02:28:15.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:15.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 Processor -- start 2024-08-17T02:28:15.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 -- start start 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f40a415d540 0x7f40a40af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f40a40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40b0270 con 0x7f40a406e830 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40af660 con 0x7f40a415d540 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40aac32700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40af940 con 0x7f40a40a9430 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a3fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f40a406e830 0x7f40a40a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35074/0 (socket says 172.21.15.155:35074) 2024-08-17T02:28:15.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a3fff700 1 -- 172.21.15.155:0/1620062281 learned_addr learned my addr 172.21.15.155:0/1620062281 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 --2- 172.21.15.155:0/1620062281 >> v2:172.21.15.189:3300/0 conn(0x7f40a415d540 0x7f40a40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a91cf700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f40a40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477420275 0 0) 0x7f40a40b0270 con 0x7f40a406e830 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f408c003570 con 0x7f40a406e830 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45984947 0 0) 0x7f408c003570 con 0x7f40a406e830 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 msgr2=0x7f40a40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f40a40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 >> v2:172.21.15.189:3300/0 conn(0x7f40a415d540 msgr2=0x7f40a40af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 --2- 172.21.15.155:0/1620062281 >> v2:172.21.15.189:3300/0 conn(0x7f40a415d540 0x7f40a40af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40afc20 con 0x7f40a406e830 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f409c0017f0 con 0x7f40a406e830 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 >> v1:172.21.15.155:6789/0 conn(0x7f40a406e830 legacy=0x7f40a40a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f408c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c004810 0x7f408c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f408c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40af660 con 0x7f408c003a60 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40af940 con 0x7f408c004810 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c00ba60 con 0x7f40a40a9430 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f408c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a3fff700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c004810 0x7f408c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a91cf700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f408c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 -- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 msgr2=0x7f408c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a40a9430 0x7f408c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 -- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c004810 msgr2=0x7f408c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f408c004810 0x7f408c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 -- 172.21.15.155:0/1620062281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c003570 con 0x7f408c003a60 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.264+0000 7f40a89ce700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f408c003e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4098009c30 tx=0x7f40980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7091b9b31f6e50 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800e710 con 0x7f408c003a60 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800e870 con 0x7f408c003a60 2024-08-17T02:28:15.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40a37fe700 1 -- 172.21.15.155:0/1620062281 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800ec30 con 0x7f408c003a60 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- 172.21.15.155:0/1620062281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 msgr2=0x7f408c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 --2- 172.21.15.155:0/1620062281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f408c003e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4098009c30 tx=0x7f40980091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40a91cf700 1 -- 172.21.15.155:0/1620062281 reap_dead start 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- 172.21.15.155:0/1620062281 shutdown_connections 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- 172.21.15.155:0/1620062281 >> 172.21.15.155:0/1620062281 conn(0x7f40a4066e00 msgr2=0x7f40a4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- 172.21.15.155:0/1620062281 shutdown_connections 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- 172.21.15.155:0/1620062281 wait complete. 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 Processor -- start 2024-08-17T02:28:15.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.268+0000 7f40aac32700 1 -- start start 2024-08-17T02:28:15.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a414d490 0x7f40a40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40a40c8e20 0x7f40a416dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a416eb80 con 0x7f408c003a60 2024-08-17T02:28:15.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40c8450 con 0x7f40a40c8e20 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a416e5c0 con 0x7f40a414d490 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45032/0 (socket says 172.21.15.155:45032) 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 -- 172.21.15.155:0/2761074909 learned_addr learned my addr 172.21.15.155:0/2761074909 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a3fff700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a414d490 0x7f40a40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a91cf700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40a40c8e20 0x7f40a416dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 -- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a414d490 msgr2=0x7f40a40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a414d490 0x7f40a40c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 -- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40a40c8e20 msgr2=0x7f40a416dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40a40c8e20 0x7f40a416dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 -- 172.21.15.155:0/2761074909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a416e8a0 con 0x7f408c003a60 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a89ce700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f409800e4b0 tx=0x7f409801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098022070 con 0x7f408c003a60 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800e9e0 con 0x7f408c003a60 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a40c80e0 con 0x7f408c003a60 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098006e50 con 0x7f408c003a60 2024-08-17T02:28:15.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.272+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a416e340 con 0x7f408c003a60 2024-08-17T02:28:15.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a40c7f40 con 0x7f408c003a60 2024-08-17T02:28:15.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f409801c660 con 0x7f408c003a60 2024-08-17T02:28:15.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40a0ff9700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 0x7f4090062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f409807e190 con 0x7f408c003a60 2024-08-17T02:28:15.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40a3fff700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 0x7f4090062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.276+0000 7f40a3fff700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 0x7f4090062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f409c0014a0 tx=0x7f409c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.284+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f40a40c7f40 con 0x7f408c003a60 2024-08-17T02:28:15.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.484+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40a40c7f40 con 0x7f408c003a60 2024-08-17T02:28:15.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.484+0000 7f40a0ff9700 1 -- 172.21.15.155:0/2761074909 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4098017060 con 0x7f408c003a60 2024-08-17T02:28:15.489 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 msgr2=0x7f4090062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 0x7f4090062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f409c0014a0 tx=0x7f409c006040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 msgr2=0x7f40a414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f409800e4b0 tx=0x7f409801a000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 shutdown_connections 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4090060860 0x7f4090062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40a40c8e20 0x7f40a416dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f40a414d490 0x7f40a40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 --2- 172.21.15.155:0/2761074909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c003a60 0x7f40a414cf50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 >> 172.21.15.155:0/2761074909 conn(0x7f40a4066e00 msgr2=0x7f40a415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 shutdown_connections 2024-08-17T02:28:15.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:15.488+0000 7f40aac32700 1 -- 172.21.15.155:0/2761074909 wait complete. 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:15.503 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:15.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:15.504 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:15.504 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:15.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.504 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-08-17T02:28:15.509 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:79:63:41:aa brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:42:1b:69:27:96 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b85f:afff:fe4a:5177/64 scope link 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.511 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:42:1b:69:27:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c42:1bff:fe69:2796/64 scope link 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether e2:ee:7b:45:d7:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::e0ee:7bff:fe45:d79e/64 scope link 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.512 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:15.567 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-08-17T02:28:15.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.569 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:28:15.578 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:15.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:15.579 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-08-17T02:28:15.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.618 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-08-17T02:28:15.668 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:15.669 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:15.669 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:15.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-08-17T02:28:15.684 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:28:15.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:15.684 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:15.689 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:15.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:15.689 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:15.741 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:28:15.757 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:15.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:15.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:15.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:15.768 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:28:15.815 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:28:15.815 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:28:15.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:28:15.832 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:15.832 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:15.842 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:15.843 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:15.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:15.843 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:28:15.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:2024-08-17T02:28:15.904+0000 7f8ee2163380 -1 init, newargv = 0x556558706620 newargc=15 2024-08-17T02:28:15.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[32403]: starting ceph client 2024-08-17T02:28:15.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[32403]: starting fuse 2024-08-17T02:28:16.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-08-17T02:28:16.969 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:16.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:17.025 INFO:teuthology.orchestra.run.smithi155.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:17.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:17.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:17.026 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-08-17T02:28:17.033 INFO:teuthology.orchestra.run.smithi155.stdout:51 2024-08-17T02:28:17.033 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [51] 2024-08-17T02:28:17.033 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-08-17T02:28:17.034 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.0")) 2024-08-17T02:28:17.035 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-08-17T02:28:17.112 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.0.32403.asok 2024-08-17T02:28:17.298 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32403.asok 2024-08-17T02:28:17.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:17.299 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32403.asok status 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "0", 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:28:17.395 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "32403", 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 5124, 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 5124 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 147747068 2024-08-17T02:28:17.396 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 147747068 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.5124 192.168.0.1:0/147747068", 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/147747068", 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 14, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 32, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-08-17T02:28:17.397 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:28:17.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:17.404 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-08-17T02:28:17.404 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:17.412 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-08-17T02:28:17.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:17.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:17.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:17.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:17.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 Processor -- start 2024-08-17T02:28:17.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 -- start start 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19c4142c30 0x7f19c4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40b2220 con 0x7f19c406ee30 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40b2500 con 0x7f19c4142860 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.580+0000 7f19cabe0700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c4159790 con 0x7f19c4142c30 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c93dd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19c4142c30 0x7f19c4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19ca3df700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f19c406ee30 0x7f19c415a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35078/0 (socket says 172.21.15.155:35078) 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19ca3df700 1 -- 172.21.15.155:0/4270847853 learned_addr learned my addr 172.21.15.155:0/4270847853 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:17.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c93dd700 1 -- 172.21.15.155:0/4270847853 >> v1:172.21.15.189:6789/0 conn(0x7f19c4142860 legacy=0x7f19c406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c8bdc700 1 -- 172.21.15.155:0/4270847853 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240255639 0 0) 0x7f19c40b2500 con 0x7f19c4142860 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c93dd700 1 -- 172.21.15.155:0/4270847853 >> v1:172.21.15.155:6789/0 conn(0x7f19c406ee30 legacy=0x7f19c415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c93dd700 1 -- 172.21.15.155:0/4270847853 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40b27e0 con 0x7f19c4142c30 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c93dd700 1 --2- 172.21.15.155:0/4270847853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142c30 0x7f19c4159be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098e0 tx=0x7f19b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499c363eb6eafbab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c8bdc700 1 -- 172.21.15.155:0/4270847853 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4009e80 con 0x7f19c4142c30 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c8bdc700 1 -- 172.21.15.155:0/4270847853 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400b760 con 0x7f19c4142c30 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19c8bdc700 1 -- 172.21.15.155:0/4270847853 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400bae0 con 0x7f19c4142c30 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 -- 172.21.15.155:0/4270847853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142c30 msgr2=0x7f19c4159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 --2- 172.21.15.155:0/4270847853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142c30 0x7f19c4159be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098e0 tx=0x7f19b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 -- 172.21.15.155:0/4270847853 shutdown_connections 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 --2- 172.21.15.155:0/4270847853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142c30 0x7f19c4159be0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 -- 172.21.15.155:0/4270847853 >> 172.21.15.155:0/4270847853 conn(0x7f19c40ca2b0 msgr2=0x7f19c406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 -- 172.21.15.155:0/4270847853 shutdown_connections 2024-08-17T02:28:17.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.584+0000 7f19cabe0700 1 -- 172.21.15.155:0/4270847853 wait complete. 2024-08-17T02:28:17.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 Processor -- start 2024-08-17T02:28:17.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- start start 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19c406ee30 0x7f19c415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19c4142c30 0x7f19c415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c415f440 con 0x7f19c4142860 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c415e3a0 con 0x7f19c4142c30 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c415e680 con 0x7f19c406ee30 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45060/0 (socket says 172.21.15.155:45060) 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 -- 172.21.15.155:0/1980722417 learned_addr learned my addr 172.21.15.155:0/1980722417 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c9bde700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19c406ee30 0x7f19c415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19ca3df700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19c4142c30 0x7f19c415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 -- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19c406ee30 msgr2=0x7f19c415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19c406ee30 0x7f19c415bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 -- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19c4142c30 msgr2=0x7f19c415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19c4142c30 0x7f19c415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 -- 172.21.15.155:0/1980722417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009420 con 0x7f19c4142860 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19c93dd700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19b40030c0 tx=0x7f19b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400bae0 con 0x7f19c4142860 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b401c460 con 0x7f19c4142860 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c415e960 con 0x7f19c4142860 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b401c820 con 0x7f19c4142860 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.588+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c415ef20 con 0x7f19c4142860 2024-08-17T02:28:17.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c415f140 con 0x7f19c4142860 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f19b401cb90 con 0x7f19c4142860 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19b9ffb700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 0x7f19a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19b407ee90 con 0x7f19c4142860 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19c9bde700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 0x7f19a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.592+0000 7f19c9bde700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 0x7f19a8062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19c40c79b0 tx=0x7f19c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.600+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f19b404f2e0 con 0x7f19c4142860 2024-08-17T02:28:17.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.800+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19c415f110 con 0x7f19c4142860 2024-08-17T02:28:17.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.800+0000 7f19b9ffb700 1 -- 172.21.15.155:0/1980722417 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19b4052900 con 0x7f19c4142860 2024-08-17T02:28:17.804 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 msgr2=0x7f19a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 0x7f19a8062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19c40c79b0 tx=0x7f19c0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 msgr2=0x7f19c415c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19b40030c0 tx=0x7f19b4016000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 shutdown_connections 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f19a8060860 0x7f19a8062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19c4142c30 0x7f19c415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19c4142860 0x7f19c415c920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 --2- 172.21.15.155:0/1980722417 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19c406ee30 0x7f19c415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 >> 172.21.15.155:0/1980722417 conn(0x7f19c40ca2b0 msgr2=0x7f19c40afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 shutdown_connections 2024-08-17T02:28:17.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:17.804+0000 7f19cabe0700 1 -- 172.21.15.155:0/1980722417 wait complete. 2024-08-17T02:28:17.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:17.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:17.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi189.front.sepia.ceph.com 2024-08-17T02:28:17.816 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:17.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:17.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:17.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:17.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:17.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:17.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.817 DEBUG:teuthology.orchestra.run.smithi189:> ip addr 2024-08-17T02:28:17.825 INFO:teuthology.orchestra.run.smithi189.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:18 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:d9:3b:19 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 0c:c4:7a:88:6d:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.826 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.21.15.189/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft 42555sec preferred_lft 42555sec 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::ec4:7aff:fe88:6df1/64 scope link 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 02:42:be:e1:db:76 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 76:eb:3d:f7:83:5e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::f8a2:88ff:fee5:d898/64 scope link 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 7a:43:b5:b0:3e:28 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:17.827 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::7843:b5ff:feb0:3e28/64 scope link 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run.smithi189.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run.smithi189.stdout: link/ether 76:eb:3d:f7:83:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run.smithi189.stdout: inet6 fe80::74eb:3dff:fef7:835e/64 scope link 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run.smithi189.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:17.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.828 DEBUG:teuthology.orchestra.run.smithi189:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:17.881 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-08-17T02:28:17.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.883 DEBUG:teuthology.orchestra.run.smithi189:> route 2024-08-17T02:28:17.892 INFO:teuthology.orchestra.run.smithi189.stdout:Kernel IP routing table 2024-08-17T02:28:17.892 INFO:teuthology.orchestra.run.smithi189.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:17.892 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run.smithi189.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run.smithi189.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run.smithi189.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run.smithi189.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:17.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> (cd / && exec bash -c ' 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> set -e 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:17.893 DEBUG:teuthology.orchestra.run.smithi189:> ') 2024-08-17T02:28:17.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.933 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-08-17T02:28:17.938 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:17.938 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:17.938 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:17.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.938 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link set brx.0 up 2024-08-17T02:28:17.953 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:28:17.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:17.954 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:17.958 INFO:teuthology.orchestra.run.smithi189.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:17.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:17.958 DEBUG:teuthology.orchestra.run.smithi189:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:17.963 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:28:18.022 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:18.022 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:18.038 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:18.040 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:18.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:18.040 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:28:18.046 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:28:18.047 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:28:18.089 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:28:18.104 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:18.105 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:18.115 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:18.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:18.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:18.116 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:28:18.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:2024-08-17T02:28:18.165+0000 7f384b5ed380 -1 init, newargv = 0x55f2b7bb39e0 newargc=15 2024-08-17T02:28:18.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:ceph-fuse[29980]: starting ceph client 2024-08-17T02:28:18.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:ceph-fuse[29980]: starting fuse 2024-08-17T02:28:19.266 DEBUG:teuthology.orchestra.run.smithi189:> sudo modprobe fuse 2024-08-17T02:28:19.285 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:28:19.285 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:28:19.295 INFO:teuthology.orchestra.run.smithi189.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:28:19.296 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:28:19.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:19.297 DEBUG:teuthology.orchestra.run.smithi189:> ls /sys/fs/fuse/connections 2024-08-17T02:28:19.345 INFO:teuthology.orchestra.run.smithi189.stdout:52 2024-08-17T02:28:19.345 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> import glob 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> import re 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> import os 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> import subprocess 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> def _find_admin_socket(client_name): 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> files = glob.glob(asok_path) 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:28:19.346 DEBUG:teuthology.orchestra.run.smithi189:> # Given a non-glob path, it better be there 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> if "*" not in asok_path: 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> assert(len(files) == 1) 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> return files[0] 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> for f in files: 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> contents = proc_f.read() 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> if mountpoint in contents: 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> return f 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> print(_find_admin_socket("client.1")) 2024-08-17T02:28:19.347 DEBUG:teuthology.orchestra.run.smithi189:> ' 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi189.stdout:/var/run/ceph/ceph-client.1.29980.asok 2024-08-17T02:28:19.614 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29980.asok 2024-08-17T02:28:19.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:19.614 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29980.asok status 2024-08-17T02:28:19.713 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-08-17T02:28:19.713 INFO:teuthology.orchestra.run.smithi189.stdout: "metadata": { 2024-08-17T02:28:19.713 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:28:19.713 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "entity_id": "1", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "hostname": "smithi189", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "pid": "29980", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "root": "/" 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_count": 0, 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "dentry_pinned_count": 0, 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "id": 5128, 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "inst": { 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "name": { 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "client", 2024-08-17T02:28:19.714 INFO:teuthology.orchestra.run.smithi189.stdout: "num": 5128 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 3246325050 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": { 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "type": "v1", 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "nonce": 3246325050 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "inst_str": "client.5128 192.168.0.1:0/3246325050", 2024-08-17T02:28:19.715 INFO:teuthology.orchestra.run.smithi189.stdout: "addr_str": "192.168.0.1:0/3246325050", 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "inode_count": 1, 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_epoch": 14, 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch": 32, 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "blocklisted": false, 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout: "fs_name": "cephfs" 2024-08-17T02:28:19.716 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-08-17T02:28:19.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:19.722 DEBUG:teuthology.orchestra.run.smithi189:> stat --file-system '--printf=%T 2024-08-17T02:28:19.722 DEBUG:teuthology.orchestra.run.smithi189:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:19.730 INFO:teuthology.orchestra.run.smithi189.stdout:fuseblk 2024-08-17T02:28:19.730 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:19.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:19.730 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:19.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:28:19.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.868+0000 7f9271f80700 1 Processor -- start 2024-08-17T02:28:19.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.868+0000 7f9271f80700 1 -- start start 2024-08-17T02:28:19.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 0x7f926c0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0c5bb0 con 0x7f926c0ce640 2024-08-17T02:28:19.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0cc670 con 0x7f926c0cc230 2024-08-17T02:28:19.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b32c0 con 0x7f926c0b2e70 2024-08-17T02:28:19.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9270f7e700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f926c0ce640 0x7f926c0cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35094/0 (socket says 172.21.15.155:35094) 2024-08-17T02:28:19.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9270f7e700 1 -- 172.21.15.155:0/1625986223 learned_addr learned my addr 172.21.15.155:0/1625986223 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:19.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926bfff700 1 --2- 172.21.15.155:0/1625986223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 0x7f926c0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257853685 0 0) 0x7f926c0c5bb0 con 0x7f926c0ce640 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003570 con 0x7f926c0ce640 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822549264 0 0) 0x7f926c0cc670 con 0x7f926c0cc230 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f926c0c5bb0 con 0x7f926c0cc230 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174949609 0 0) 0x7f9254003570 con 0x7f926c0ce640 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926bfff700 1 -- 172.21.15.155:0/1625986223 >> v1:172.21.15.189:6789/0 conn(0x7f926c0cc230 legacy=0x7f926c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926bfff700 1 -- 172.21.15.155:0/1625986223 >> v1:172.21.15.155:6789/0 conn(0x7f926c0ce640 legacy=0x7f926c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926bfff700 1 -- 172.21.15.155:0/1625986223 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0c4fa0 con 0x7f926c0b2e70 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926bfff700 1 --2- 172.21.15.155:0/1625986223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 0x7f926c0cbcf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f925c009910 tx=0x7f925c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707da93ed1efe4d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260001470 con 0x7f926c0b2e70 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c011420 con 0x7f926c0b2e70 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f926b7fe700 1 -- 172.21.15.155:0/1625986223 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0117a0 con 0x7f926c0b2e70 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- 172.21.15.155:0/1625986223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 msgr2=0x7f926c0cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 --2- 172.21.15.155:0/1625986223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 0x7f926c0cbcf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f925c009910 tx=0x7f925c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- 172.21.15.155:0/1625986223 shutdown_connections 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 --2- 172.21.15.155:0/1625986223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0b2e70 0x7f926c0cbcf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- 172.21.15.155:0/1625986223 >> 172.21.15.155:0/1625986223 conn(0x7f926c099410 msgr2=0x7f926c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- 172.21.15.155:0/1625986223 shutdown_connections 2024-08-17T02:28:19.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.872+0000 7f9271f80700 1 -- 172.21.15.155:0/1625986223 wait complete. 2024-08-17T02:28:19.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 Processor -- start 2024-08-17T02:28:19.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 -- start start 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f926c0cc230 0x7f926c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 0x7f926c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c099e10 con 0x7f926c0b2e70 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0c87e0 con 0x7f926c0cc230 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9271f80700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0c8ac0 con 0x7f926c0ce640 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45072/0 (socket says 172.21.15.155:45072) 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 -- 172.21.15.155:0/866272365 learned_addr learned my addr 172.21.15.155:0/866272365 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f926bfff700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f926c0cc230 0x7f926c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f927177f700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 0x7f926c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 -- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 msgr2=0x7f926c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 0x7f926c14ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 -- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f926c0cc230 msgr2=0x7f926c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f926c0cc230 0x7f926c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f9270f7e700 1 -- 172.21.15.155:0/866272365 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009420 con 0x7f926c0b2e70 2024-08-17T02:28:19.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.876+0000 7f927177f700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 0x7f926c14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9270f7e700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f926000cb70 tx=0x7f9260001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260001d00 con 0x7f926c0b2e70 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260007360 con 0x7f926c0b2e70 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0c8da0 con 0x7f926c0b2e70 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260004830 con 0x7f926c0b2e70 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c14bfa0 con 0x7f926c0b2e70 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c06a250 con 0x7f926c0b2e70 2024-08-17T02:28:19.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.880+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9260004be0 con 0x7f926c0b2e70 2024-08-17T02:28:19.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.884+0000 7f9268ff9700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 0x7f9258062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.884+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f926007c380 con 0x7f926c0b2e70 2024-08-17T02:28:19.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.884+0000 7f926bfff700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 0x7f9258062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.884+0000 7f926bfff700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 0x7f9258062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f925c003080 tx=0x7f925c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:19.892+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f926004c850 con 0x7f926c0b2e70 2024-08-17T02:28:20.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.092+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f926c0644b0 con 0x7f926c0b2e70 2024-08-17T02:28:20.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.508+0000 7f9268ff9700 1 -- 172.21.15.155:0/866272365 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7f926004fe70 con 0x7f926c0b2e70 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 msgr2=0x7f9258062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 0x7f9258062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f925c003080 tx=0x7f925c016000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 msgr2=0x7f926c0c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f926000cb70 tx=0x7f9260001ab0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 shutdown_connections 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9258060860 0x7f9258062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f926c0ce640 0x7f926c14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f926c0cc230 0x7f926c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 --2- 172.21.15.155:0/866272365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f926c0b2e70 0x7f926c0c8150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 >> 172.21.15.155:0/866272365 conn(0x7f926c099410 msgr2=0x7f926c0c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 shutdown_connections 2024-08-17T02:28:20.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.512+0000 7f9271f80700 1 -- 172.21.15.155:0/866272365 wait complete. 2024-08-17T02:28:20.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:20.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.648+0000 7fde55939700 1 Processor -- start 2024-08-17T02:28:20.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.648+0000 7fde55939700 1 -- start start 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500686a0 0x7fde50068b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde5015b5c0 0x7fde5015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde50069050 con 0x7fde500ac3a0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde50153d90 con 0x7fde5015b5c0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5015b130 con 0x7fde500686a0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fde500ac3a0 0x7fde50159840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35104/0 (socket says 172.21.15.155:35104) 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4effd700 1 -- 172.21.15.155:0/4065937623 learned_addr learned my addr 172.21.15.155:0/4065937623 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 --2- 172.21.15.155:0/4065937623 >> v2:172.21.15.155:3300/0 conn(0x7fde5015b5c0 0x7fde5015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4e7fc700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500686a0 0x7fde50068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4dffb700 1 -- 172.21.15.155:0/4065937623 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194501793 0 0) 0x7fde50069050 con 0x7fde500ac3a0 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4dffb700 1 -- 172.21.15.155:0/4065937623 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde30003570 con 0x7fde500ac3a0 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 -- 172.21.15.155:0/4065937623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500686a0 msgr2=0x7fde50068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500686a0 0x7fde50068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 -- 172.21.15.155:0/4065937623 >> v1:172.21.15.155:6789/0 conn(0x7fde500ac3a0 legacy=0x7fde50159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 -- 172.21.15.155:0/4065937623 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5015a300 con 0x7fde5015b5c0 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4f7fe700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde5015b5c0 0x7fde5015ba40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fde380098e0 tx=0x7fde380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7df09814858cdbb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4dffb700 1 -- 172.21.15.155:0/4065937623 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011630 con 0x7fde5015b5c0 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4dffb700 1 -- 172.21.15.155:0/4065937623 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38011790 con 0x7fde5015b5c0 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde4dffb700 1 -- 172.21.15.155:0/4065937623 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011b10 con 0x7fde5015b5c0 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- 172.21.15.155:0/4065937623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde5015b5c0 msgr2=0x7fde5015ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde5015b5c0 0x7fde5015ba40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fde380098e0 tx=0x7fde380091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- 172.21.15.155:0/4065937623 shutdown_connections 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde5015b5c0 0x7fde5015ba40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 --2- 172.21.15.155:0/4065937623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500686a0 0x7fde50068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- 172.21.15.155:0/4065937623 >> 172.21.15.155:0/4065937623 conn(0x7fde5006e4e0 msgr2=0x7fde5006bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- 172.21.15.155:0/4065937623 shutdown_connections 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.652+0000 7fde55939700 1 -- 172.21.15.155:0/4065937623 wait complete. 2024-08-17T02:28:20.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 Processor -- start 2024-08-17T02:28:20.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 -- start start 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500ac3a0 0x7fde50151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 0x7fde50151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b17a0 con 0x7fde500686a0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50149810 con 0x7fde5015b5c0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde55939700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b0b90 con 0x7fde500ac3a0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45078/0 (socket says 172.21.15.155:45078) 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 -- 172.21.15.155:0/2829830925 learned_addr learned my addr 172.21.15.155:0/2829830925 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4f7fe700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 0x7fde50151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4e7fc700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500ac3a0 0x7fde50151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 -- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500ac3a0 msgr2=0x7fde50151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500ac3a0 0x7fde50151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 -- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 msgr2=0x7fde50151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 0x7fde50151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 -- 172.21.15.155:0/2829830925 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38009420 con 0x7fde500686a0 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4f7fe700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 0x7fde50151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.656+0000 7fde4effd700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fde480011e0 tx=0x7fde48007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48005b30 con 0x7fde500686a0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48005c90 con 0x7fde500686a0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48007320 con 0x7fde500686a0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500b0e70 con 0x7fde500686a0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500b1430 con 0x7fde500686a0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500645c0 con 0x7fde500686a0 2024-08-17T02:28:20.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fde48007690 con 0x7fde500686a0 2024-08-17T02:28:20.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.660+0000 7fde46ffd700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 0x7fde34062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.664+0000 7fde4e7fc700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 0x7fde34062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.664+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde4807c110 con 0x7fde500686a0 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.664+0000 7fde4e7fc700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 0x7fde34062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde4000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.668+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fde4804c4c0 con 0x7fde500686a0 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.856+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fde500b18e0 con 0x7fde34060860 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.860+0000 7fde46ffd700 1 -- 172.21.15.155:0/2829830925 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fde4000f040 con 0x7fde34060860 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "cephfs" 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 msgr2=0x7fde34062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 0x7fde34062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde4000b040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 msgr2=0x7fde501492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fde480011e0 tx=0x7fde48007df0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 shutdown_connections 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fde34060860 0x7fde34062d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde5015b5c0 0x7fde50151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fde500ac3a0 0x7fde50151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 --2- 172.21.15.155:0/2829830925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde500686a0 0x7fde501492d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 >> 172.21.15.155:0/2829830925 conn(0x7fde5006e4e0 msgr2=0x7fde50159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 shutdown_connections 2024-08-17T02:28:20.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.864+0000 7fde55939700 1 -- 172.21.15.155:0/2829830925 wait complete. 2024-08-17T02:28:20.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:20.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.984+0000 7fb561556700 1 Processor -- start 2024-08-17T02:28:20.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.984+0000 7fb561556700 1 -- start start 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb55c1597d0 0x7fb55c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb55c06bac0 0x7fb55c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0adb00 con 0x7fb55c159400 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c06bf60 con 0x7fb55c1597d0 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0ac630 con 0x7fb55c06bac0 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb55c1597d0 0x7fb55c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb55c159400 0x7fb55c0ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35108/0 (socket says 172.21.15.155:35108) 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55affd700 1 -- 172.21.15.155:0/475286070 learned_addr learned my addr 172.21.15.155:0/475286070 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:20.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55b7fe700 1 --2- 172.21.15.155:0/475286070 >> v2:172.21.15.189:3300/0 conn(0x7fb55c06bac0 0x7fb55c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 -- 172.21.15.155:0/475286070 >> v2:172.21.15.189:3300/0 conn(0x7fb55c06bac0 msgr2=0x7fb55c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 --2- 172.21.15.155:0/475286070 >> v2:172.21.15.189:3300/0 conn(0x7fb55c06bac0 0x7fb55c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 -- 172.21.15.155:0/475286070 >> v1:172.21.15.155:6789/0 conn(0x7fb55c159400 legacy=0x7fb55c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb559ffb700 1 -- 172.21.15.155:0/475286070 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771174615 0 0) 0x7fb55c0adb00 con 0x7fb55c159400 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 -- 172.21.15.155:0/475286070 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0ac910 con 0x7fb55c1597d0 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb55a7fc700 1 --2- 172.21.15.155:0/475286070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c1597d0 0x7fb55c0b1c00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0710b0 tx=0x7fb544009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25e6ab6bfe8effe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb559ffb700 1 -- 172.21.15.155:0/475286070 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400e070 con 0x7fb55c1597d0 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb559ffb700 1 -- 172.21.15.155:0/475286070 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400bb60 con 0x7fb55c1597d0 2024-08-17T02:28:20.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb559ffb700 1 -- 172.21.15.155:0/475286070 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544012430 con 0x7fb55c1597d0 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- 172.21.15.155:0/475286070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c1597d0 msgr2=0x7fb55c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 --2- 172.21.15.155:0/475286070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c1597d0 0x7fb55c0b1c00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0710b0 tx=0x7fb544009780 comp rx=0 tx=0).stop 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- 172.21.15.155:0/475286070 shutdown_connections 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 --2- 172.21.15.155:0/475286070 >> v2:172.21.15.189:3300/0 conn(0x7fb55c06bac0 0x7fb55c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 --2- 172.21.15.155:0/475286070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c1597d0 0x7fb55c0b1c00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.988+0000 7fb561556700 1 -- 172.21.15.155:0/475286070 >> 172.21.15.155:0/475286070 conn(0x7fb55c0c9bf0 msgr2=0x7fb55c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.992+0000 7fb561556700 1 -- 172.21.15.155:0/475286070 shutdown_connections 2024-08-17T02:28:20.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.992+0000 7fb561556700 1 -- 172.21.15.155:0/475286070 wait complete. 2024-08-17T02:28:20.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.992+0000 7fb561556700 1 Processor -- start 2024-08-17T02:28:20.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.992+0000 7fb561556700 1 -- start start 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c159400 0x7fb55c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 0x7fb55c153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c155700 con 0x7fb55c06bac0 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c150100 con 0x7fb55c159400 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c154a80 con 0x7fb55c1597d0 2024-08-17T02:28:20.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45102/0 (socket says 172.21.15.155:45102) 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 -- 172.21.15.155:0/2698771096 learned_addr learned my addr 172.21.15.155:0/2698771096 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55a7fc700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c159400 0x7fb55c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55b7fe700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 0x7fb55c153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 -- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 msgr2=0x7fb55c153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 0x7fb55c153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 -- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c159400 msgr2=0x7fb55c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c159400 0x7fb55c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 -- 172.21.15.155:0/2698771096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009a20 con 0x7fb55c06bac0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55b7fe700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 0x7fb55c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb55affd700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c7e0 tx=0x7fb54c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c005b30 con 0x7fb55c06bac0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c005c90 con 0x7fb55c06bac0 2024-08-17T02:28:21.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0072e0 con 0x7fb55c06bac0 2024-08-17T02:28:21.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c154d60 con 0x7fb55c06bac0 2024-08-17T02:28:21.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c155320 con 0x7fb55c06bac0 2024-08-17T02:28:21.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0645c0 con 0x7fb55c06bac0 2024-08-17T02:28:21.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:20.996+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb54c0076d0 con 0x7fb55c06bac0 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.000+0000 7fb552ffd700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.000+0000 7fb55a7fc700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.000+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb54c07c050 con 0x7fb55c06bac0 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.000+0000 7fb55a7fc700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 0x7fb53c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5440097c0 tx=0x7fb544019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.008+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb54c04a480 con 0x7fb55c06bac0 2024-08-17T02:28:21.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.172+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb55c0cc3a0 con 0x7fb55c06bac0 2024-08-17T02:28:21.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.172+0000 7fb552ffd700 1 -- 172.21.15.155:0/2698771096 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb54c0170c0 con 0x7fb55c06bac0 2024-08-17T02:28:21.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 msgr2=0x7fb53c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 0x7fb53c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5440097c0 tx=0x7fb544019000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 msgr2=0x7fb55c14fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c7e0 tx=0x7fb54c007df0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 shutdown_connections 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb55c1597d0 0x7fb55c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb55c159400 0x7fb55c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 --2- 172.21.15.155:0/2698771096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb55c06bac0 0x7fb55c14fbc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 >> 172.21.15.155:0/2698771096 conn(0x7fb55c0c9bf0 msgr2=0x7fb55c0ad570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 shutdown_connections 2024-08-17T02:28:21.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.176+0000 7fb561556700 1 -- 172.21.15.155:0/2698771096 wait complete. 2024-08-17T02:28:21.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000005383 2024-08-17T02:28:21.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 Processor -- start 2024-08-17T02:28:21.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 -- start start 2024-08-17T02:28:21.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 0x7f72f406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72f40b14a0 0x7f72f4157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f406e010 con 0x7f72f41574f0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f406efa0 con 0x7f72f40b14a0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f88a9700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f4157fb0 con 0x7f72f41514d0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72f40b14a0 0x7f72f4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72f40b14a0 0x7f72f4157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45118/0 (socket says 172.21.15.155:45118) 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f3fff700 1 -- 172.21.15.155:0/3278575027 learned_addr learned my addr 172.21.15.155:0/3278575027 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.296+0000 7f72f37fe700 1 --2- 172.21.15.155:0/3278575027 >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 0x7f72f406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 -- 172.21.15.155:0/3278575027 >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 msgr2=0x7f72f406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 --2- 172.21.15.155:0/3278575027 >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 0x7f72f406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 -- 172.21.15.155:0/3278575027 >> v1:172.21.15.189:6789/0 conn(0x7f72f41574f0 legacy=0x7f72f40b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 -- 172.21.15.155:0/3278575027 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4158290 con 0x7f72f40b14a0 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f37fe700 1 --2- 172.21.15.155:0/3278575027 >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 0x7f72f406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:21.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 --2- 172.21.15.155:0/3278575027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f40b14a0 0x7f72f4157990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f72f405f080 tx=0x7f72ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8588eca4aaaee991 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f27fc700 1 -- 172.21.15.155:0/3278575027 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00e070 con 0x7f72f40b14a0 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f27fc700 1 -- 172.21.15.155:0/3278575027 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec00ba50 con 0x7f72f40b14a0 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f27fc700 1 -- 172.21.15.155:0/3278575027 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0092e0 con 0x7f72f40b14a0 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- 172.21.15.155:0/3278575027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f40b14a0 msgr2=0x7f72f4157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- 172.21.15.155:0/3278575027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f40b14a0 0x7f72f4157990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f72f405f080 tx=0x7f72ec009840 comp rx=0 tx=0).stop 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- 172.21.15.155:0/3278575027 shutdown_connections 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- 172.21.15.155:0/3278575027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f40b14a0 0x7f72f4157990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- 172.21.15.155:0/3278575027 >> v2:172.21.15.189:3300/0 conn(0x7f72f41514d0 0x7f72f406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- 172.21.15.155:0/3278575027 >> 172.21.15.155:0/3278575027 conn(0x7f72f40678a0 msgr2=0x7f72f4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- 172.21.15.155:0/3278575027 shutdown_connections 2024-08-17T02:28:21.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- 172.21.15.155:0/3278575027 wait complete. 2024-08-17T02:28:21.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 Processor -- start 2024-08-17T02:28:21.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- start start 2024-08-17T02:28:21.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72f40b14a0 0x7f72f406abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f41574f0 0x7f72f414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4155300 con 0x7f72f41514d0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f406a110 con 0x7f72f41574f0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f88a9700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4155020 con 0x7f72f40b14a0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45134/0 (socket says 172.21.15.155:45134) 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 -- 172.21.15.155:0/115851278 learned_addr learned my addr 172.21.15.155:0/115851278 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f3fff700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f41574f0 0x7f72f414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f37fe700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72f40b14a0 0x7f72f406abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 -- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72f40b14a0 msgr2=0x7f72f406abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72f40b14a0 0x7f72f406abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 -- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f41574f0 msgr2=0x7f72f414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f41574f0 0x7f72f414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.300+0000 7f72f2ffd700 1 -- 172.21.15.155:0/115851278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009ae0 con 0x7f72f41514d0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f2ffd700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00c590 tx=0x7f72dc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc011590 con 0x7f72f41514d0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc011730 con 0x7f72f41514d0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc011af0 con 0x7f72f41514d0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f406a3b0 con 0x7f72f41514d0 2024-08-17T02:28:21.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f41528a0 con 0x7f72f41514d0 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f4069f80 con 0x7f72f41514d0 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f72dc012420 con 0x7f72f41514d0 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 0x7f72d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f37fe700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 0x7f72d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72dc07bdd0 con 0x7f72f41514d0 2024-08-17T02:28:21.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.304+0000 7f72f37fe700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 0x7f72d4062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72e400adc0 tx=0x7f72e4006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.312+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f72dc04c2d0 con 0x7f72f41514d0 2024-08-17T02:28:21.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:21.496+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000005383", "target": ["mon-mgr", ""]}) v1 -- 0x7f72f4152ac0 con 0x7f72d4060860 2024-08-17T02:28:23.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.608+0000 7f72eb7fe700 1 -- 172.21.15.155:0/115851278 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f72f4152ac0 con 0x7f72d4060860 2024-08-17T02:28:23.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 msgr2=0x7f72d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 0x7f72d4062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72e400adc0 tx=0x7f72e4006f90 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 msgr2=0x7f72f4152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00c590 tx=0x7f72dc007f30 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 shutdown_connections 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f72d4060860 0x7f72d4062d10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f41574f0 0x7f72f414dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72f41514d0 0x7f72f4152360 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 --2- 172.21.15.155:0/115851278 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72f40b14a0 0x7f72f406abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 >> 172.21.15.155:0/115851278 conn(0x7f72f40678a0 msgr2=0x7f72f40ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 shutdown_connections 2024-08-17T02:28:23.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.616+0000 7f72f88a9700 1 -- 172.21.15.155:0/115851278 wait complete. 2024-08-17T02:28:23.620 INFO:teuthology.orchestra.run.smithi155.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:28:23.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:23.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 Processor -- start 2024-08-17T02:28:23.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 -- start start 2024-08-17T02:28:23.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 0x7fbaac0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaac0cb450 0x7fbaac06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac0cb870 con 0x7fbaac06e470 2024-08-17T02:28:23.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac158290 con 0x7fbaac0cb450 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbab0d77700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac1610c0 con 0x7fbaac0adf10 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaac0cb450 0x7fbaac06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaac0cb450 0x7fbaac06e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37478/0 (socket says 172.21.15.155:37478) 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 -- 172.21.15.155:0/3642714873 learned_addr learned my addr 172.21.15.155:0/3642714873 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaa59c700 1 --2- 172.21.15.155:0/3642714873 >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 0x7fbaac0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 -- 172.21.15.155:0/3642714873 >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 msgr2=0x7fbaac0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 --2- 172.21.15.155:0/3642714873 >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 0x7fbaac0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 -- 172.21.15.155:0/3642714873 >> v1:172.21.15.189:6789/0 conn(0x7fbaac06e470 legacy=0x7fbaac0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 -- 172.21.15.155:0/3642714873 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0ae820 con 0x7fbaac0cb450 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaa59c700 1 --2- 172.21.15.155:0/3642714873 >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 0x7fbaac0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaaad9d700 1 --2- 172.21.15.155:0/3642714873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0cb450 0x7fbaac06e910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbaac06fbc0 tx=0x7fbaa4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f822b8717e6f35f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaa959a700 1 -- 172.21.15.155:0/3642714873 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400e070 con 0x7fbaac0cb450 2024-08-17T02:28:23.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaa959a700 1 -- 172.21.15.155:0/3642714873 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa400ba50 con 0x7fbaac0cb450 2024-08-17T02:28:23.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.732+0000 7fbaa959a700 1 -- 172.21.15.155:0/3642714873 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40092e0 con 0x7fbaac0cb450 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- 172.21.15.155:0/3642714873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0cb450 msgr2=0x7fbaac06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 --2- 172.21.15.155:0/3642714873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0cb450 0x7fbaac06e910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbaac06fbc0 tx=0x7fbaa4009840 comp rx=0 tx=0).stop 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- 172.21.15.155:0/3642714873 shutdown_connections 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 --2- 172.21.15.155:0/3642714873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0cb450 0x7fbaac06e910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 --2- 172.21.15.155:0/3642714873 >> v2:172.21.15.189:3300/0 conn(0x7fbaac0adf10 0x7fbaac0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- 172.21.15.155:0/3642714873 >> 172.21.15.155:0/3642714873 conn(0x7fbaac067810 msgr2=0x7fbaac067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- 172.21.15.155:0/3642714873 shutdown_connections 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- 172.21.15.155:0/3642714873 wait complete. 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 Processor -- start 2024-08-17T02:28:23.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.736+0000 7fbab0d77700 1 -- start start 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaac06e470 0x7fbaac155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaac0cb450 0x7fbaac099480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac096c00 con 0x7fbaac0adf10 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac159310 con 0x7fbaac06e470 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0af130 con 0x7fbaac0cb450 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37486/0 (socket says 172.21.15.155:37486) 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaaa59c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaac06e470 0x7fbaac155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 -- 172.21.15.155:0/2599616319 learned_addr learned my addr 172.21.15.155:0/2599616319 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaaad9d700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaac0cb450 0x7fbaac099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 -- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaac0cb450 msgr2=0x7fbaac099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaac0cb450 0x7fbaac099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 -- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaac06e470 msgr2=0x7fbaac155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaac06e470 0x7fbaac155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 -- 172.21.15.155:0/2599616319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4009ae0 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa9d9b700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c590 tx=0x7fba9400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011590 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94011710 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac158d50 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011ad0 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac0aedc0 con 0x7fbaac0adf10 2024-08-17T02:28:23.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.740+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac0645c0 con 0x7fbaac0adf10 2024-08-17T02:28:23.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.744+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fba94012420 con 0x7fbaac0adf10 2024-08-17T02:28:23.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.744+0000 7fbaa27fc700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 0x7fba8c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.744+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fba9407c340 con 0x7fbaac0adf10 2024-08-17T02:28:23.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.744+0000 7fbaaa59c700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 0x7fba8c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.744+0000 7fbaaa59c700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 0x7fba8c062d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006f00 tx=0x7fba9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.752+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fba9404c4c0 con 0x7fbaac0adf10 2024-08-17T02:28:23.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.940+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaac06efa0 con 0x7fba8c060890 2024-08-17T02:28:23.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.944+0000 7fbaa27fc700 1 -- 172.21.15.155:0/2599616319 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7fbaac06efa0 con 0x7fba8c060890 2024-08-17T02:28:23.947 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-08-17T02:28:23.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "cephfs" 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "volume_0000000000005383" 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 msgr2=0x7fba8c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 0x7fba8c062d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006f00 tx=0x7fba9c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 msgr2=0x7fbaac1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c590 tx=0x7fba9400c8a0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 shutdown_connections 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fba8c060890 0x7fba8c062d40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbaac0cb450 0x7fbaac099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaac0adf10 0x7fbaac1583e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 --2- 172.21.15.155:0/2599616319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaac06e470 0x7fbaac155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 >> 172.21.15.155:0/2599616319 conn(0x7fbaac067810 msgr2=0x7fbaac0aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 shutdown_connections 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:23.948+0000 7fbab0d77700 1 -- 172.21.15.155:0/2599616319 wait complete. 2024-08-17T02:28:23.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:28:24.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 Processor -- start 2024-08-17T02:28:24.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- start start 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0781596d0 0x7fe078066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe07815dbc0 0x7fe078067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780cba90 con 0x7fe078159300 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780b2b60 con 0x7fe0781596d0 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780b2940 con 0x7fe07815dbc0 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0781596d0 0x7fe078066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0781596d0 0x7fe078066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37490/0 (socket says 172.21.15.155:37490) 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 -- 172.21.15.155:0/2061331016 learned_addr learned my addr 172.21.15.155:0/2061331016 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe077fff700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe07815dbc0 0x7fe078067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 -- 172.21.15.155:0/2061331016 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe07815dbc0 msgr2=0x7fe078067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe07815dbc0 0x7fe078067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 -- 172.21.15.155:0/2061331016 >> v1:172.21.15.189:6789/0 conn(0x7fe078159300 legacy=0x7fe0780b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 -- 172.21.15.155:0/2061331016 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780cb160 con 0x7fe0781596d0 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe076ffd700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0781596d0 0x7fe078066e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0099e0 tx=0x7fe06c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3cd46954492bb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe0767fc700 1 -- 172.21.15.155:0/2061331016 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c00b820 con 0x7fe0781596d0 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe0767fc700 1 -- 172.21.15.155:0/2061331016 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00b980 con 0x7fe0781596d0 2024-08-17T02:28:24.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe0767fc700 1 -- 172.21.15.155:0/2061331016 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c00bd20 con 0x7fe0781596d0 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- 172.21.15.155:0/2061331016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0781596d0 msgr2=0x7fe078066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0781596d0 0x7fe078066e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0099e0 tx=0x7fe06c009250 comp rx=0 tx=0).stop 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- 172.21.15.155:0/2061331016 shutdown_connections 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe07815dbc0 0x7fe078067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/2061331016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0781596d0 0x7fe078066e00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- 172.21.15.155:0/2061331016 >> 172.21.15.155:0/2061331016 conn(0x7fe0780682c0 msgr2=0x7fe0780686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- 172.21.15.155:0/2061331016 shutdown_connections 2024-08-17T02:28:24.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.071+0000 7fe07dcfc700 1 -- 172.21.15.155:0/2061331016 wait complete. 2024-08-17T02:28:24.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 Processor -- start 2024-08-17T02:28:24.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 -- start start 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0781596d0 0x7fe07814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 0x7fe0780c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816cfb0 con 0x7fe07815dbc0 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816d290 con 0x7fe078159300 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe07dcfc700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07816d570 con 0x7fe0781596d0 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 0x7fe0780c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:41116/0 (socket says 172.21.15.155:41116) 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0781596d0 0x7fe07814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe0777fe700 1 -- 172.21.15.155:0/4260789132 learned_addr learned my addr 172.21.15.155:0/4260789132 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 -- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0781596d0 msgr2=0x7fe07814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0781596d0 0x7fe07814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 -- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 msgr2=0x7fe0780c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.075+0000 7fe077fff700 1 -- 172.21.15.155:0/4260789132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0094f0 con 0x7fe07815dbc0 2024-08-17T02:28:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe0777fe700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe077fff700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 0x7fe0780c5e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe070007ed0 tx=0x7fe070009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070018070 con 0x7fe07815dbc0 2024-08-17T02:28:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000eb90 con 0x7fe07815dbc0 2024-08-17T02:28:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07816d850 con 0x7fe07815dbc0 2024-08-17T02:28:24.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070014420 con 0x7fe07815dbc0 2024-08-17T02:28:24.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780c8c30 con 0x7fe07815dbc0 2024-08-17T02:28:24.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0780645c0 con 0x7fe07815dbc0 2024-08-17T02:28:24.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.079+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe070003020 con 0x7fe07815dbc0 2024-08-17T02:28:24.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.083+0000 7fe05f7fe700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 0x7fe064062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.083+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe07007d050 con 0x7fe07815dbc0 2024-08-17T02:28:24.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.083+0000 7fe0777fe700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 0x7fe064062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.083+0000 7fe0777fe700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 0x7fe064062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe068001df0 tx=0x7fe068009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.087+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe07004d120 con 0x7fe07815dbc0 2024-08-17T02:28:24.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.251+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fe0780caac0 con 0x7fe07815dbc0 2024-08-17T02:28:24.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe05f7fe700 1 -- 172.21.15.155:0/4260789132 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fe070050740 con 0x7fe07815dbc0 2024-08-17T02:28:24.259 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:24.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 msgr2=0x7fe064062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 0x7fe064062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe068001df0 tx=0x7fe068009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 msgr2=0x7fe0780c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 0x7fe0780c5e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe070007ed0 tx=0x7fe070009850 comp rx=0 tx=0).stop 2024-08-17T02:28:24.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 shutdown_connections 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe064060860 0x7fe064062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe07815dbc0 0x7fe0780c5e00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0781596d0 0x7fe07814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 --2- 172.21.15.155:0/4260789132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe078159300 0x7fe0780c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 >> 172.21.15.155:0/4260789132 conn(0x7fe0780682c0 msgr2=0x7fe0780cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 shutdown_connections 2024-08-17T02:28:24.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.255+0000 7fe07dcfc700 1 -- 172.21.15.155:0/4260789132 wait complete. 2024-08-17T02:28:24.272 INFO:teuthology.orchestra.run.smithi155.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}] 2024-08-17T02:28:24.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000005383 --format=json 2024-08-17T02:28:24.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 Processor -- start 2024-08-17T02:28:24.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 -- start start 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff17006e620 0x7ff1700b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b1630 0x7ff170141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff170141a00 con 0x7ff1700b0d20 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff170140b10 con 0x7ff17006e620 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175d38700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff170140df0 con 0x7ff1700b1630 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff17006e620 0x7ff1700b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff174d36700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff1700b0d20 0x7ff17006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:42866/0 (socket says 172.21.15.155:42866) 2024-08-17T02:28:24.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff174d36700 1 -- 172.21.15.155:0/4284887759 learned_addr learned my addr 172.21.15.155:0/4284887759 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff175537700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b1630 0x7ff170141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16f7fe700 1 -- 172.21.15.155:0/4284887759 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636321430 0 0) 0x7ff170141a00 con 0x7ff1700b0d20 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16f7fe700 1 -- 172.21.15.155:0/4284887759 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c003570 con 0x7ff1700b0d20 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 -- 172.21.15.155:0/4284887759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b1630 msgr2=0x7ff170141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b1630 0x7ff170141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 -- 172.21.15.155:0/4284887759 >> v1:172.21.15.155:6789/0 conn(0x7ff1700b0d20 legacy=0x7ff17006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 -- 172.21.15.155:0/4284887759 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1701410d0 con 0x7ff17006e620 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16ffff700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17006e620 0x7ff1700b10f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff168009e60 tx=0x7ff168009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acee46bdeb20ad7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16f7fe700 1 -- 172.21.15.155:0/4284887759 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800e070 con 0x7ff17006e620 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16f7fe700 1 -- 172.21.15.155:0/4284887759 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16800bb60 con 0x7ff17006e620 2024-08-17T02:28:24.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.379+0000 7ff16f7fe700 1 -- 172.21.15.155:0/4284887759 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168012430 con 0x7ff17006e620 2024-08-17T02:28:24.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- 172.21.15.155:0/4284887759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17006e620 msgr2=0x7ff1700b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17006e620 0x7ff1700b10f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff168009e60 tx=0x7ff168009780 comp rx=0 tx=0).stop 2024-08-17T02:28:24.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- 172.21.15.155:0/4284887759 shutdown_connections 2024-08-17T02:28:24.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b1630 0x7ff170141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 --2- 172.21.15.155:0/4284887759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17006e620 0x7ff1700b10f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- 172.21.15.155:0/4284887759 >> 172.21.15.155:0/4284887759 conn(0x7ff1700678d0 msgr2=0x7ff170067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- 172.21.15.155:0/4284887759 shutdown_connections 2024-08-17T02:28:24.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- 172.21.15.155:0/4284887759 wait complete. 2024-08-17T02:28:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 Processor -- start 2024-08-17T02:28:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.383+0000 7ff175d38700 1 -- start start 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff17006e620 0x7ff1700a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 0x7ff170171450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170144ee0 con 0x7ff1700b1630 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700a5990 con 0x7ff17006e620 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701442d0 con 0x7ff1700b0d20 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37526/0 (socket says 172.21.15.155:37526) 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 -- 172.21.15.155:0/3476912888 learned_addr learned my addr 172.21.15.155:0/3476912888 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff174d36700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff17006e620 0x7ff1700a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff16ffff700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 0x7ff170171450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 -- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 msgr2=0x7ff170171450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 0x7ff170171450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 -- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff17006e620 msgr2=0x7ff1700a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff17006e620 0x7ff1700a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 -- 172.21.15.155:0/3476912888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168009a20 con 0x7ff1700b1630 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff16ffff700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 0x7ff170171450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175537700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff15800d890 tx=0x7ff158008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580125f0 con 0x7ff1700b1630 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158012770 con 0x7ff1700b1630 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158012b30 con 0x7ff1700b1630 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1701445b0 con 0x7ff1700b1630 2024-08-17T02:28:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff170144b70 con 0x7ff1700b1630 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.387+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff170145050 con 0x7ff1700b1630 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.391+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff15801e460 con 0x7ff1700b1630 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.391+0000 7ff16cff9700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.391+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff15807d730 con 0x7ff1700b1630 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.391+0000 7ff174d36700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.391+0000 7ff174d36700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1600058d0 tx=0x7ff160009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.399+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff15804d800 con 0x7ff1700b1630 2024-08-17T02:28:24.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.603+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000005383", "format": "json"} v 0) v1 -- 0x7ff1700643a0 con 0x7ff1700b1630 2024-08-17T02:28:24.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff16cff9700 1 -- 172.21.15.155:0/3476912888 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000005383", "format": "json"}]=0 v17) v1 ==== 110+0+1847 (secure 0 0 0) 0x7ff158050e20 con 0x7ff1700b1630 2024-08-17T02:28:24.613 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:28:24.614 INFO:teuthology.orchestra.run.smithi155.stdout:{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":0},"id":3} 2024-08-17T02:28:24.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 msgr2=0x7ff150062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1600058d0 tx=0x7ff160009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 msgr2=0x7ff1700ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff15800d890 tx=0x7ff158008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 shutdown_connections 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700b1630 0x7ff1700ad490 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1700b0d20 0x7ff170171450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 --2- 172.21.15.155:0/3476912888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff17006e620 0x7ff1700a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 >> 172.21.15.155:0/3476912888 conn(0x7ff1700678d0 msgr2=0x7ff17015daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 shutdown_connections 2024-08-17T02:28:24.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.611+0000 7ff175d38700 1 -- 172.21.15.155:0/3476912888 wait complete. 2024-08-17T02:28:24.628 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000005383 --yes-i-really-mean-it 2024-08-17T02:28:24.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.731+0000 7f89ff59e700 1 Processor -- start 2024-08-17T02:28:24.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- start start 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a000aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a0013fa50 0x7f8a000ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a000afc70 con 0x7f8a000b0100 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000adc00 con 0x7f8a0013fa50 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a000af060 con 0x7f8a0013f680 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a0013fa50 0x7f8a000ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a0013fa50 0x7f8a000ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37538/0 (socket says 172.21.15.155:37538) 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 -- 172.21.15.155:0/204848012 learned_addr learned my addr 172.21.15.155:0/204848012 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fe59c700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a000aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 -- 172.21.15.155:0/204848012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 msgr2=0x7f8a000aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a000aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 -- 172.21.15.155:0/204848012 >> v1:172.21.15.189:6789/0 conn(0x7f8a000b0100 legacy=0x7f8a0006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 -- 172.21.15.155:0/204848012 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000af340 con 0x7f8a0013fa50 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fe59c700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a000aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fdd9b700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ad6c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89f40099b0 tx=0x7f89f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38555b3ff699d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fd59a700 1 -- 172.21.15.155:0/204848012 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400b860 con 0x7f8a0013fa50 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fd59a700 1 -- 172.21.15.155:0/204848012 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f400b9c0 con 0x7f8a0013fa50 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89fd59a700 1 -- 172.21.15.155:0/204848012 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400bd60 con 0x7f8a0013fa50 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- 172.21.15.155:0/204848012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 msgr2=0x7f8a000ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ad6c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89f40099b0 tx=0x7f89f4009250 comp rx=0 tx=0).stop 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- 172.21.15.155:0/204848012 shutdown_connections 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ad6c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 --2- 172.21.15.155:0/204848012 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a000aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- 172.21.15.155:0/204848012 >> 172.21.15.155:0/204848012 conn(0x7f8a000678a0 msgr2=0x7f8a00067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- 172.21.15.155:0/204848012 shutdown_connections 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.735+0000 7f89ff59e700 1 -- 172.21.15.155:0/204848012 wait complete. 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 Processor -- start 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 -- start start 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a000b0100 0x7f8a00133e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a001558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00156fb0 con 0x7f8a0013fa50 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00134370 con 0x7f8a000b0100 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89ff59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00158870 con 0x7f8a0013f680 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fe59c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a000b0100 0x7f8a00133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fe59c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a000b0100 0x7f8a00133e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:41130/0 (socket says 172.21.15.155:41130) 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37546/0 (socket says 172.21.15.155:37546) 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fe59c700 1 -- 172.21.15.155:0/709196645 learned_addr learned my addr 172.21.15.155:0/709196645 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.739+0000 7f89fdd9b700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a001558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 -- 172.21.15.155:0/709196645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 msgr2=0x7f8a001558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8a0013f680 0x7f8a001558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 -- 172.21.15.155:0/709196645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a000b0100 msgr2=0x7f8a00133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a000b0100 0x7f8a00133e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 -- 172.21.15.155:0/709196645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40094f0 con 0x7f8a0013fa50 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89fed9d700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0013fa50 0x7f8a000ab6e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c860 tx=0x7f89f8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8012630 con 0x7f8a0013fa50 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8012790 con 0x7f8a0013fa50 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ff59e700 1 -- 172.21.15.155:0/709196645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a00155de0 con 0x7f8a0013fa50 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8012b50 con 0x7f8a0013fa50 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ff59e700 1 -- 172.21.15.155:0/709196645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a00134650 con 0x7f8a0013fa50 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ff59e700 1 -- 172.21.15.155:0/709196645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a00134c80 con 0x7f8a0013fa50 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f89f8011380 con 0x7f8a0013fa50 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.743+0000 7f89ee7fc700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f89e0060860 0x7f89e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.747+0000 7f89fe59c700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f89e0060860 0x7f89e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.747+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f89f807d0f0 con 0x7f8a0013fa50 2024-08-17T02:28:24.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.747+0000 7f89fe59c700 1 --2- 172.21.15.155:0/709196645 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f89e0060860 0x7f89e0062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f89f0006fd0 tx=0x7f89f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.751+0000 7f89ee7fc700 1 -- 172.21.15.155:0/709196645 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f89f804d120 con 0x7f8a0013fa50 2024-08-17T02:28:24.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:28:24.935+0000 7f89ff59e700 1 -- 172.21.15.155:0/709196645 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000005383", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a00158a00 con 0x7f89e0060860 2024-08-17T02:28:28.284 INFO:tasks.ceph.mds.b.smithi189.stderr:2024-08-17T02:28:28.281+0000 7f63826ce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:32.593 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:32.596 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:02.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:02.653 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:32.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:32.705 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:02.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:02.772 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:24.647 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:30:24.648 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:30:24.648 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:24.669 DEBUG:teuthology.orchestra.run.smithi189:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:24.690 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:30:24.690 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-08-17T02:30:24.691 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:30:24.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:24.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[32403]: fuse finished with error 0 and tester_r 0 2024-08-17T02:30:24.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:30:24.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:24.705 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:30:24.874 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi189.front.sepia.ceph.com... 2024-08-17T02:30:24.874 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:30:24.874 DEBUG:teuthology.orchestra.run.smithi189:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:24.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi189.stderr:ceph-fuse[29980]: fuse finished with error 0 and tester_r 0 2024-08-17T02:30:24.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:30:24.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:24.891 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:30:24.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:30:24.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:24.942 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:30:24.950 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:30:24.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:24.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:30:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:24.951 DEBUG:teuthology.orchestra.run.smithi189:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:30:24.958 INFO:teuthology.orchestra.run.smithi189.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:30:24.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:24.960 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:25.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.105+0000 7f9bf68ca700 1 Processor -- start 2024-08-17T02:30:25.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.105+0000 7f9bf68ca700 1 -- start start 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9bf00b02f0 0x7f9bf0157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f9bf00b0dc0 0x7f9bf00b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf00ca2c0 con 0x7f9bf0154ba0 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf00b15d0 con 0x7f9bf00b02f0 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf0154f70 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9bf00b02f0 0x7f9bf0157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9bf00b02f0 0x7f9bf0157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40800/0 (socket says 172.21.15.155:40800) 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 -- 172.21.15.155:0/232253796 learned_addr learned my addr 172.21.15.155:0/232253796 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:25.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf60c9700 1 --2- 172.21.15.155:0/232253796 >> v2:172.21.15.189:3300/0 conn(0x7f9bf00b0dc0 0x7f9bf00b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 -- 172.21.15.155:0/232253796 >> v2:172.21.15.189:3300/0 conn(0x7f9bf00b0dc0 msgr2=0x7f9bf00b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 --2- 172.21.15.155:0/232253796 >> v2:172.21.15.189:3300/0 conn(0x7f9bf00b0dc0 0x7f9bf00b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 -- 172.21.15.155:0/232253796 >> v1:172.21.15.189:6789/0 conn(0x7f9bf0154ba0 legacy=0x7f9bf00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 -- 172.21.15.155:0/232253796 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf0158410 con 0x7f9bf00b02f0 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf50c7700 1 --2- 172.21.15.155:0/232253796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0157ed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bf006fbb0 tx=0x7f9be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fa7bbcfdbc4276 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf48c6700 1 -- 172.21.15.155:0/232253796 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000b7e0 con 0x7f9bf00b02f0 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf48c6700 1 -- 172.21.15.155:0/232253796 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000b940 con 0x7f9bf00b02f0 2024-08-17T02:30:25.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf48c6700 1 -- 172.21.15.155:0/232253796 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000bce0 con 0x7f9bf00b02f0 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- 172.21.15.155:0/232253796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b02f0 msgr2=0x7f9bf0157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/232253796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0157ed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bf006fbb0 tx=0x7f9be0009250 comp rx=0 tx=0).stop 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- 172.21.15.155:0/232253796 shutdown_connections 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/232253796 >> v2:172.21.15.189:3300/0 conn(0x7f9bf00b0dc0 0x7f9bf00b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/232253796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0157ed0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- 172.21.15.155:0/232253796 >> 172.21.15.155:0/232253796 conn(0x7f9bf00ca930 msgr2=0x7f9bf00cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- 172.21.15.155:0/232253796 shutdown_connections 2024-08-17T02:30:25.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 -- 172.21.15.155:0/232253796 wait complete. 2024-08-17T02:30:25.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.109+0000 7f9bf68ca700 1 Processor -- start 2024-08-17T02:30:25.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- start start 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9bf0154ba0 0x7f9bf00c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0151bb0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0151e90 con 0x7f9bf00b02f0 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0152170 con 0x7f9bf0154ba0 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40812/0 (socket says 172.21.15.155:40812) 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 -- 172.21.15.155:0/3868791216 learned_addr learned my addr 172.21.15.155:0/3868791216 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:25.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf58c8700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf60c9700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9bf0154ba0 0x7f9bf00c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 -- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9bf0154ba0 msgr2=0x7f9bf00c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9bf0154ba0 0x7f9bf00c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 -- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9bf00b02f0 msgr2=0x7f9bf0149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 -- 172.21.15.155:0/3868791216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00094f0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf50c7700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009290 tx=0x7f9be0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0011bb0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0020070 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf0152450 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be001b450 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.113+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf014a010 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf00ca6a0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9be0022030 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9be5ffb700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 0x7f9bd4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9be007ed30 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9bf58c8700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 0x7f9bd4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.117+0000 7f9bf58c8700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 0x7f9bd4062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003a30 tx=0x7f9bec007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.121+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9be004eda0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.321+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf00ca6a0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9be5ffb700 1 -- 172.21.15.155:0/3868791216 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f9be00523c0 con 0x7f9bf00b0dc0 2024-08-17T02:30:25.326 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:25.326 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:25.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 msgr2=0x7f9bd4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 0x7f9bd4062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003a30 tx=0x7f9bec007ea0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 msgr2=0x7f9bf00c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009290 tx=0x7f9be0016000 comp rx=0 tx=0).stop 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 shutdown_connections 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9bd4060860 0x7f9bd4062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9bf0154ba0 0x7f9bf00c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bf00b0dc0 0x7f9bf00c33b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 --2- 172.21.15.155:0/3868791216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9bf00b02f0 0x7f9bf0149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 >> 172.21.15.155:0/3868791216 conn(0x7f9bf00ca930 msgr2=0x7f9bf0156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 shutdown_connections 2024-08-17T02:30:25.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.325+0000 7f9bf68ca700 1 -- 172.21.15.155:0/3868791216 wait complete. 2024-08-17T02:30:25.330 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-08-17T02:30:25.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:25.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.445+0000 7f1978b4c700 1 Processor -- start 2024-08-17T02:30:25.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.445+0000 7f1978b4c700 1 -- start start 2024-08-17T02:30:25.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f197414f930 0x7f19740b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1974155b30 con 0x7f1974068db0 2024-08-17T02:30:25.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1974155df0 con 0x7f19740b21b0 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19740af730 con 0x7f197414f930 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1973fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1974068db0 0x7f19740ad500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46922/0 (socket says 172.21.15.155:46922) 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1973fff700 1 -- 172.21.15.155:0/2324810912 learned_addr learned my addr 172.21.15.155:0/2324810912 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 --2- 172.21.15.155:0/2324810912 >> v2:172.21.15.189:3300/0 conn(0x7f197414f930 0x7f19740b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413125046 0 0) 0x7f1974155b30 con 0x7f1974068db0 2024-08-17T02:30:25.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c004680 con 0x7f1974068db0 2024-08-17T02:30:25.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945261796 0 0) 0x7f1974155df0 con 0x7f19740b21b0 2024-08-17T02:30:25.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1974155b30 con 0x7f19740b21b0 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570276393 0 0) 0x7f195c004680 con 0x7f1974068db0 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 >> v2:172.21.15.189:3300/0 conn(0x7f197414f930 msgr2=0x7f19740b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 --2- 172.21.15.155:0/2324810912 >> v2:172.21.15.189:3300/0 conn(0x7f197414f930 0x7f19740b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 >> v1:172.21.15.189:6789/0 conn(0x7f19740b21b0 legacy=0x7f19740686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19741560d0 con 0x7f1974068db0 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f196c0017f0 con 0x7f1974068db0 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 >> v1:172.21.15.155:6789/0 conn(0x7f1974068db0 legacy=0x7f19740ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 0x7f195c005140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c005920 0x7f195c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c006320 0x7f195c00cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c00d240 con 0x7f195c004d50 2024-08-17T02:30:25.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c00d380 con 0x7f195c006320 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c00d510 con 0x7f195c005920 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 0x7f195c005140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1973fff700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c006320 0x7f195c00cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1972ffd700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c005920 0x7f195c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 -- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c005920 msgr2=0x7f195c005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c005920 0x7f195c005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 -- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c006320 msgr2=0x7f195c00cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f195c006320 0x7f195c00cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 -- 172.21.15.155:0/2324810912 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c004680 con 0x7f195c004d50 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1973fff700 1 -- 172.21.15.155:0/2324810912 reap_dead start 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1972ffd700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c005920 0x7f195c005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:25.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19737fe700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 0x7f195c005140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1968009c30 tx=0x7f19680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f93636eac7cfd8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800e6e0 con 0x7f195c004d50 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196800e840 con 0x7f195c004d50 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f19727fc700 1 -- 172.21.15.155:0/2324810912 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800ec00 con 0x7f195c004d50 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 msgr2=0x7f195c005140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 0x7f195c005140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1968009c30 tx=0x7f19680091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- 172.21.15.155:0/2324810912 shutdown_connections 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 --2- 172.21.15.155:0/2324810912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f195c004d50 0x7f195c005140 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- 172.21.15.155:0/2324810912 >> 172.21.15.155:0/2324810912 conn(0x7f197406d790 msgr2=0x7f197406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- 172.21.15.155:0/2324810912 shutdown_connections 2024-08-17T02:30:25.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.449+0000 7f1978b4c700 1 -- 172.21.15.155:0/2324810912 wait complete. 2024-08-17T02:30:25.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 Processor -- start 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 -- start start 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c004d50 0x7f19741692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f197414b7e0 0x7f1974149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974169810 con 0x7f197414a2b0 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197414bd50 con 0x7f197414b7e0 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1978b4c700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197414c030 con 0x7f195c004d50 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40834/0 (socket says 172.21.15.155:40834) 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 -- 172.21.15.155:0/778537958 learned_addr learned my addr 172.21.15.155:0/778537958 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f19737fe700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c004d50 0x7f19741692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1972ffd700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f197414b7e0 0x7f1974149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 -- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c004d50 msgr2=0x7f19741692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c004d50 0x7f19741692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 -- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f197414b7e0 msgr2=0x7f1974149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f197414b7e0 0x7f1974149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.453+0000 7f1973fff700 1 -- 172.21.15.155:0/778537958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197414c310 con 0x7f197414a2b0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f1973fff700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1974159090 tx=0x7f196c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c00ac90 con 0x7f197414a2b0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c00ae30 con 0x7f197414a2b0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197414c5f0 con 0x7f197414a2b0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c013640 con 0x7f197414a2b0 2024-08-17T02:30:25.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19740a9a90 con 0x7f197414a2b0 2024-08-17T02:30:25.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19740643a0 con 0x7f197414a2b0 2024-08-17T02:30:25.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f196c013a70 con 0x7f197414a2b0 2024-08-17T02:30:25.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 0x7f1960062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f196c07d880 con 0x7f197414a2b0 2024-08-17T02:30:25.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f19737fe700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 0x7f1960062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.457+0000 7f19737fe700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 0x7f1960062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19680091e0 tx=0x7f196801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.465+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f196c04d8e0 con 0x7f197414a2b0 2024-08-17T02:30:25.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.629+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19740ad130 con 0x7f197414a2b0 2024-08-17T02:30:25.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.629+0000 7f195b7fe700 1 -- 172.21.15.155:0/778537958 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f196c050f00 con 0x7f197414a2b0 2024-08-17T02:30:25.632 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:25.633 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:29:11.669598+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.17","mappings":[{"from":4,"to":3}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 msgr2=0x7f1960062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 0x7f1960062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19680091e0 tx=0x7f196801a000 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 msgr2=0x7f1974141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1974159090 tx=0x7f196c0020c0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 shutdown_connections 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1960060860 0x7f1960062d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f197414a2b0 0x7f1974141b70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f197414b7e0 0x7f1974149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 --2- 172.21.15.155:0/778537958 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f195c004d50 0x7f19741692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 >> 172.21.15.155:0/778537958 conn(0x7f197406d790 msgr2=0x7f1974067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 shutdown_connections 2024-08-17T02:30:25.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.633+0000 7f1978b4c700 1 -- 172.21.15.155:0/778537958 wait complete. 2024-08-17T02:30:25.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:28:07.199540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:28:08.283844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000005383.meta', 'create_time': '2024-08-17T02:28:21.542725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000005383'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000005383.data', 'create_time': '2024-08-17T02:28:21.639804+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000005383'}}}] 2024-08-17T02:30:25.652 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:25.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 Processor -- start 2024-08-17T02:30:25.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 -- start start 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e5c15cb60 0x7f9e5c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cd3d0 0x7f9e5c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c0cd840 con 0x7f9e5c0cf020 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5c0b2e80 con 0x7f9e5c15cb60 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c0cf4a0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e5c15cb60 0x7f9e5c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e5c15cb60 0x7f9e5c0cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40846/0 (socket says 172.21.15.155:40846) 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 -- 172.21.15.155:0/3046024520 learned_addr learned my addr 172.21.15.155:0/3046024520 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e59d9b700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cd3d0 0x7f9e5c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 -- 172.21.15.155:0/3046024520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cd3d0 msgr2=0x7f9e5c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cd3d0 0x7f9e5c0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 -- 172.21.15.155:0/3046024520 >> v1:172.21.15.189:6789/0 conn(0x7f9e5c0cf020 legacy=0x7f9e5c0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 -- 172.21.15.155:0/3046024520 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c0cca00 con 0x7f9e5c15cb60 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5a59c700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0cce90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0099b0 tx=0x7f9e4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a2b8d107c2562 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5959a700 1 -- 172.21.15.155:0/3046024520 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c009ea0 con 0x7f9e5c15cb60 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5959a700 1 -- 172.21.15.155:0/3046024520 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c00b860 con 0x7f9e5c15cb60 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e5959a700 1 -- 172.21.15.155:0/3046024520 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00bc00 con 0x7f9e5c15cb60 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 -- 172.21.15.155:0/3046024520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c15cb60 msgr2=0x7f9e5c0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.765+0000 7f9e60df8700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0cce90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0099b0 tx=0x7f9e4c009250 comp rx=0 tx=0).stop 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- 172.21.15.155:0/3046024520 shutdown_connections 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cd3d0 0x7f9e5c0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 --2- 172.21.15.155:0/3046024520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0cce90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- 172.21.15.155:0/3046024520 >> 172.21.15.155:0/3046024520 conn(0x7f9e5c0996d0 msgr2=0x7f9e5c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- 172.21.15.155:0/3046024520 shutdown_connections 2024-08-17T02:30:25.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- 172.21.15.155:0/3046024520 wait complete. 2024-08-17T02:30:25.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 Processor -- start 2024-08-17T02:30:25.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- start start 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 0x7f9e5c0ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c09adf0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c14b010 con 0x7f9e5c15cb60 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e60df8700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c09a170 con 0x7f9e5c0cf020 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40858/0 (socket says 172.21.15.155:40858) 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.769+0000 7f9e5a59c700 1 -- 172.21.15.155:0/724476785 learned_addr learned my addr 172.21.15.155:0/724476785 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5ad9d700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e59d9b700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 0x7f9e5c0ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 -- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 msgr2=0x7f9e5c0ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 0x7f9e5c0ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 -- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 msgr2=0x7f9e5c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 -- 172.21.15.155:0/724476785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0094f0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5ad9d700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e59d9b700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 0x7f9e5c0ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e5a59c700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c067fc0 tx=0x7f9e4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00bbe0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c011420 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0117c0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c09a450 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c09aa10 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c0645c0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.773+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9e4c011bf0 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.777+0000 7f9e4a7fc700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 0x7f9e3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:25.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.777+0000 7f9e59d9b700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 0x7f9e3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:25.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.777+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9e4c07e840 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.777+0000 7f9e59d9b700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 0x7f9e3c062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006f00 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.781+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9e4c04ea00 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.945+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e5c09b660 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.945+0000 7f9e4a7fc700 1 -- 172.21.15.155:0/724476785 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e4c052020 con 0x7f9e5c0cd3d0 2024-08-17T02:30:25.948 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:30:25.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 msgr2=0x7f9e3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 0x7f9e3c062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006f00 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 msgr2=0x7f9e5c14aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c067fc0 tx=0x7f9e4c017000 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 shutdown_connections 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9e3c060860 0x7f9e3c062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e5c15cb60 0x7f9e5c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9e5c0cf020 0x7f9e5c0ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 --2- 172.21.15.155:0/724476785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e5c0cd3d0 0x7f9e5c14aad0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 >> 172.21.15.155:0/724476785 conn(0x7f9e5c0996d0 msgr2=0x7f9e5c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 shutdown_connections 2024-08-17T02:30:25.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:25.949+0000 7f9e60df8700 1 -- 172.21.15.155:0/724476785 wait complete. 2024-08-17T02:30:25.967 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:30:26.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.073+0000 7fe0d58fe700 1 Processor -- start 2024-08-17T02:30:26.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.073+0000 7fe0d58fe700 1 -- start start 2024-08-17T02:30:26.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 0x7fe0d015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00aff80 con 0x7fe0d0140770 2024-08-17T02:30:26.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00adb50 con 0x7fe0d015b010 2024-08-17T02:30:26.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d015b4b0 con 0x7fe0d0140b40 2024-08-17T02:30:26.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d48fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe0d0140770 0x7fe0d00ad110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46934/0 (socket says 172.21.15.155:46934) 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d48fc700 1 -- 172.21.15.155:0/852135629 learned_addr learned my addr 172.21.15.155:0/852135629 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cffff700 1 --2- 172.21.15.155:0/852135629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 0x7fe0d015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452188326 0 0) 0x7fe0d00aff80 con 0x7fe0d0140770 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c0003570 con 0x7fe0d0140770 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752488440 0 0) 0x7fe0d00adb50 con 0x7fe0d015b010 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d00aff80 con 0x7fe0d015b010 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658359439 0 0) 0x7fe0c0003570 con 0x7fe0d0140770 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cffff700 1 -- 172.21.15.155:0/852135629 >> v1:172.21.15.189:6789/0 conn(0x7fe0d015b010 legacy=0x7fe0d00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cffff700 1 -- 172.21.15.155:0/852135629 >> v1:172.21.15.155:6789/0 conn(0x7fe0d0140770 legacy=0x7fe0d00ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cffff700 1 -- 172.21.15.155:0/852135629 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d00ade30 con 0x7fe0d0140b40 2024-08-17T02:30:26.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cffff700 1 --2- 172.21.15.155:0/852135629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 0x7fe0d015aad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009910 tx=0x7fe0bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d35d656fe3ed9c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4001470 con 0x7fe0d0140b40 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc011420 con 0x7fe0d0140b40 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0cf7fe700 1 -- 172.21.15.155:0/852135629 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0117c0 con 0x7fe0d0140b40 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 -- 172.21.15.155:0/852135629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 msgr2=0x7fe0d015aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/852135629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 0x7fe0d015aad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009910 tx=0x7fe0bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.077+0000 7fe0d58fe700 1 -- 172.21.15.155:0/852135629 shutdown_connections 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/852135629 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140b40 0x7fe0d015aad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- 172.21.15.155:0/852135629 >> 172.21.15.155:0/852135629 conn(0x7fe0d00c9830 msgr2=0x7fe0d00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- 172.21.15.155:0/852135629 shutdown_connections 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- 172.21.15.155:0/852135629 wait complete. 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 Processor -- start 2024-08-17T02:30:26.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- start start 2024-08-17T02:30:26.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140770 0x7fe0d0154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0d0140b40 0x7fe0d00680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00689f0 con 0x7fe0d015b010 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0068cd0 con 0x7fe0d0140b40 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0068fb0 con 0x7fe0d0140770 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40870/0 (socket says 172.21.15.155:40870) 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 -- 172.21.15.155:0/2036585617 learned_addr learned my addr 172.21.15.155:0/2036585617 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0cffff700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0d0140b40 0x7fe0d00680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d48fc700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140770 0x7fe0d0154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 -- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140770 msgr2=0x7fe0d0154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140770 0x7fe0d0154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 -- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0d0140b40 msgr2=0x7fe0d00680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0d0140b40 0x7fe0d00680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 -- 172.21.15.155:0/2036585617 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009420 con 0x7fe0d015b010 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d50fd700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c860 tx=0x7fe0c8002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8002030 con 0x7fe0d015b010 2024-08-17T02:30:26.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80021b0 con 0x7fe0d015b010 2024-08-17T02:30:26.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d0069290 con 0x7fe0d015b010 2024-08-17T02:30:26.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8012630 con 0x7fe0d015b010 2024-08-17T02:30:26.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.081+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d0068630 con 0x7fe0d015b010 2024-08-17T02:30:26.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d0069790 con 0x7fe0d015b010 2024-08-17T02:30:26.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe0c8012a20 con 0x7fe0d015b010 2024-08-17T02:30:26.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0ccff9700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 0x7fe0b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe0c807d730 con 0x7fe0d015b010 2024-08-17T02:30:26.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0d48fc700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 0x7fe0b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.085+0000 7fe0d48fc700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 0x7fe0b4062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40015a0 tx=0x7fe0c4000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.093+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe0c804d810 con 0x7fe0d015b010 2024-08-17T02:30:26.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.253+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0d00638f0 con 0x7fe0d015b010 2024-08-17T02:30:26.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.253+0000 7fe0ccff9700 1 -- 172.21.15.155:0/2036585617 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0c8050e30 con 0x7fe0d015b010 2024-08-17T02:30:26.257 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:30:26.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 msgr2=0x7fe0b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 0x7fe0b4062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40015a0 tx=0x7fe0c4000bc0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 msgr2=0x7fe0d012f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c860 tx=0x7fe0c8002700 comp rx=0 tx=0).stop 2024-08-17T02:30:26.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 shutdown_connections 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fe0b4060860 0x7fe0b4062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d015b010 0x7fe0d012f160 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0d0140b40 0x7fe0d00680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 --2- 172.21.15.155:0/2036585617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe0d0140770 0x7fe0d0154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 >> 172.21.15.155:0/2036585617 conn(0x7fe0d00c9830 msgr2=0x7fe0d00acca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 shutdown_connections 2024-08-17T02:30:26.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.257+0000 7fe0d58fe700 1 -- 172.21.15.155:0/2036585617 wait complete. 2024-08-17T02:30:26.270 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:30:26.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 Processor -- start 2024-08-17T02:30:26.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 -- start start 2024-08-17T02:30:26.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77a41505b0 0x7f77a40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f77a4068be0 0x7f77a40af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a4157160 con 0x7f77a41501e0 2024-08-17T02:30:26.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a4069020 con 0x7f77a41505b0 2024-08-17T02:30:26.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a3fff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a4156550 con 0x7f77a4068be0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f779bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77a41505b0 0x7f77a40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f779bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77a41505b0 0x7f77a40686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40872/0 (socket says 172.21.15.155:40872) 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f779bfff700 1 -- 172.21.15.155:0/3950813489 learned_addr learned my addr 172.21.15.155:0/3950813489 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.377+0000 7f77a37fe700 1 --2- 172.21.15.155:0/3950813489 >> v2:172.21.15.189:3300/0 conn(0x7f77a4068be0 0x7f77a40af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f779bfff700 1 -- 172.21.15.155:0/3950813489 >> v2:172.21.15.189:3300/0 conn(0x7f77a4068be0 msgr2=0x7f77a40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f779bfff700 1 --2- 172.21.15.155:0/3950813489 >> v2:172.21.15.189:3300/0 conn(0x7f77a4068be0 0x7f77a40af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f779bfff700 1 -- 172.21.15.155:0/3950813489 >> v1:172.21.15.189:6789/0 conn(0x7f77a41501e0 legacy=0x7f77a40ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f779bfff700 1 -- 172.21.15.155:0/3950813489 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4156830 con 0x7f77a41505b0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f779bfff700 1 --2- 172.21.15.155:0/3950813489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a40686a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f77a40b1c60 tx=0x7f778c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7de16944bce96c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a27fc700 1 -- 172.21.15.155:0/3950813489 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00dba0 con 0x7f77a41505b0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a27fc700 1 -- 172.21.15.155:0/3950813489 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c00dd00 con 0x7f77a41505b0 2024-08-17T02:30:26.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a27fc700 1 -- 172.21.15.155:0/3950813489 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c0196d0 con 0x7f77a41505b0 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 -- 172.21.15.155:0/3950813489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 msgr2=0x7f77a40686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 --2- 172.21.15.155:0/3950813489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a40686a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f77a40b1c60 tx=0x7f778c00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 -- 172.21.15.155:0/3950813489 shutdown_connections 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 --2- 172.21.15.155:0/3950813489 >> v2:172.21.15.189:3300/0 conn(0x7f77a4068be0 0x7f77a40af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 --2- 172.21.15.155:0/3950813489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a40686a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 -- 172.21.15.155:0/3950813489 >> 172.21.15.155:0/3950813489 conn(0x7f77a406e310 msgr2=0x7f77a406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 -- 172.21.15.155:0/3950813489 shutdown_connections 2024-08-17T02:30:26.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.381+0000 7f77a3fff700 1 -- 172.21.15.155:0/3950813489 wait complete. 2024-08-17T02:30:26.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 Processor -- start 2024-08-17T02:30:26.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- start start 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77a4068be0 0x7f77a413aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77a41501e0 0x7f77a40a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4151170 con 0x7f77a41505b0 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a413b530 con 0x7f77a41501e0 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4151920 con 0x7f77a4068be0 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40876/0 (socket says 172.21.15.155:40876) 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 -- 172.21.15.155:0/2587339837 learned_addr learned my addr 172.21.15.155:0/2587339837 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f779bfff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77a41501e0 0x7f77a40a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a2ffd700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77a4068be0 0x7f77a413aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 -- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77a4068be0 msgr2=0x7f77a413aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77a4068be0 0x7f77a413aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 -- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77a41501e0 msgr2=0x7f77a40a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77a41501e0 0x7f77a40a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 -- 172.21.15.155:0/2587339837 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c00b790 con 0x7f77a41505b0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a37fe700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e90 tx=0x7f779c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00caa0 con 0x7f77a41505b0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00f040 con 0x7f77a41505b0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40a5990 con 0x7f77a41505b0 2024-08-17T02:30:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00ce50 con 0x7f77a41505b0 2024-08-17T02:30:26.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.385+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4150e90 con 0x7f77a41505b0 2024-08-17T02:30:26.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a4151ab0 con 0x7f77a41505b0 2024-08-17T02:30:26.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f779c014690 con 0x7f77a41505b0 2024-08-17T02:30:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f779affd700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 0x7f7784062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f779c07d880 con 0x7f77a41505b0 2024-08-17T02:30:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f77a2ffd700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 0x7f7784062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.389+0000 7f77a2ffd700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 0x7f7784062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77940039f0 tx=0x7f7794007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.397+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f779c051370 con 0x7f77a41505b0 2024-08-17T02:30:26.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.553+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77a40638f0 con 0x7f77a41505b0 2024-08-17T02:30:26.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.553+0000 7f779affd700 1 -- 172.21.15.155:0/2587339837 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f779c0180a0 con 0x7f77a41505b0 2024-08-17T02:30:26.555 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.553+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 msgr2=0x7f7784062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.553+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 0x7f7784062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77940039f0 tx=0x7f7794007ec0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.553+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 msgr2=0x7f77a41579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f779c009e90 tx=0x7f779c00b040 comp rx=0 tx=0).stop 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 shutdown_connections 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7784060860 0x7f7784062d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77a41505b0 0x7f77a41579c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77a41501e0 0x7f77a40a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 --2- 172.21.15.155:0/2587339837 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f77a4068be0 0x7f77a413aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 >> 172.21.15.155:0/2587339837 conn(0x7f77a406e310 msgr2=0x7f77a414de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 shutdown_connections 2024-08-17T02:30:26.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.557+0000 7f77a3fff700 1 -- 172.21.15.155:0/2587339837 wait complete. 2024-08-17T02:30:26.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000005383.meta pg_num 2024-08-17T02:30:26.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.677+0000 7f7c1e2d7700 1 Processor -- start 2024-08-17T02:30:26.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.677+0000 7f7c1e2d7700 1 -- start start 2024-08-17T02:30:26.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7c1813f680 0x7f7c180aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c180ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180afc70 con 0x7f7c180b0100 2024-08-17T02:30:26.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180adc00 con 0x7f7c1813f680 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180af060 con 0x7f7c1813fa50 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1cad4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c180ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7c1813f680 0x7f7c180aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1cad4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c180ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:56012/0 (socket says 172.21.15.155:56012) 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1cad4700 1 -- 172.21.15.155:0/918070523 learned_addr learned my addr 172.21.15.155:0/918070523 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1dad6700 1 --1- 172.21.15.155:0/918070523 >> v1:172.21.15.189:6789/0 conn(0x7f7c180b0100 0x7f7c1806e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:48312/0 (socket says 172.21.15.155:48312) 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 msgr2=0x7f7c180ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c180ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/918070523 >> v1:172.21.15.189:6789/0 conn(0x7f7c180b0100 legacy=0x7f7c1806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/918070523 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c180af340 con 0x7f7c1813f680 2024-08-17T02:30:26.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c1813f680 0x7f7c180aea80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800bb90 tx=0x7f7c0800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=836ac77ca0f4b1d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c17fff700 1 -- 172.21.15.155:0/918070523 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800db40 con 0x7f7c1813f680 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c17fff700 1 -- 172.21.15.155:0/918070523 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800dca0 con 0x7f7c1813f680 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c17fff700 1 -- 172.21.15.155:0/918070523 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080196b0 con 0x7f7c1813f680 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c1813f680 msgr2=0x7f7c180aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c1813f680 0x7f7c180aea80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800bb90 tx=0x7f7c0800b430 comp rx=0 tx=0).stop 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/918070523 shutdown_connections 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c180ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/918070523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c1813f680 0x7f7c180aea80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/918070523 >> 172.21.15.155:0/918070523 conn(0x7f7c180678a0 msgr2=0x7f7c18067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/918070523 shutdown_connections 2024-08-17T02:30:26.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.681+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/918070523 wait complete. 2024-08-17T02:30:26.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 Processor -- start 2024-08-17T02:30:26.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 -- start start 2024-08-17T02:30:26.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 0x7f7c18158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c18131020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18133250 con 0x7f7c1813f680 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1813c170 con 0x7f7c180b0100 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1e2d7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1813c450 con 0x7f7c1813fa50 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1cad4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1cad4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40892/0 (socket says 172.21.15.155:40892) 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1cad4700 1 -- 172.21.15.155:0/2233255026 learned_addr learned my addr 172.21.15.155:0/2233255026 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 0x7f7c18158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1dad6700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c18131020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 msgr2=0x7f7c18131020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c18131020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 msgr2=0x7f7c18137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1d2d5700 1 -- 172.21.15.155:0/2233255026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0800b6d0 con 0x7f7c180b0100 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.685+0000 7f7c1cad4700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c1d2d5700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 0x7f7c18158bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c08018000 tx=0x7f7c0801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801d050 con 0x7f7c180b0100 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0801e040 con 0x7f7c180b0100 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080108d0 con 0x7f7c180b0100 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1813c730 con 0x7f7c180b0100 2024-08-17T02:30:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c18137950 con 0x7f7c180b0100 2024-08-17T02:30:26.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c18064330 con 0x7f7c180b0100 2024-08-17T02:30:26.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c0802d410 con 0x7f7c180b0100 2024-08-17T02:30:26.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.689+0000 7f7c157fa700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 0x7f7c04062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.693+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7c08014070 con 0x7f7c180b0100 2024-08-17T02:30:26.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.693+0000 7f7c1cad4700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 0x7f7c04062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.693+0000 7f7c1cad4700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 0x7f7c04062d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c18136520 tx=0x7f7c0c009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.697+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c08052000 con 0x7f7c180b0100 2024-08-17T02:30:26.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.861+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.meta", "var": "pg_num"} v 0) v1 -- 0x7f7c1806ed70 con 0x7f7c180b0100 2024-08-17T02:30:26.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.861+0000 7f7c157fa700 1 -- 172.21.15.155:0/2233255026 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.meta", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f7c08055620 con 0x7f7c180b0100 2024-08-17T02:30:26.865 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:30:26.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 msgr2=0x7f7c04062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 0x7f7c04062d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c18136520 tx=0x7f7c0c009250 comp rx=0 tx=0).stop 2024-08-17T02:30:26.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 msgr2=0x7f7c18158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 0x7f7c18158bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c08018000 tx=0x7f7c0801b000 comp rx=0 tx=0).stop 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 shutdown_connections 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7c04060890 0x7f7c04062d40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7c1813fa50 0x7f7c18131020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c1813f680 0x7f7c18137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 --2- 172.21.15.155:0/2233255026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c180b0100 0x7f7c18158bc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 >> 172.21.15.155:0/2233255026 conn(0x7f7c180678a0 msgr2=0x7f7c1806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 shutdown_connections 2024-08-17T02:30:26.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.865+0000 7f7c1e2d7700 1 -- 172.21.15.155:0/2233255026 wait complete. 2024-08-17T02:30:26.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000005383.data pg_num 2024-08-17T02:30:26.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 Processor -- start 2024-08-17T02:30:26.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 -- start start 2024-08-17T02:30:26.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 0x7fbc800ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc800cd150 con 0x7fbc800b5750 2024-08-17T02:30:26.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc80159ce0 con 0x7fbc800b2210 2024-08-17T02:30:26.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8779e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800af570 con 0x7fbc800cc840 2024-08-17T02:30:26.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc85d3b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbc800b5750 0x7fbc8015cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46942/0 (socket says 172.21.15.155:46942) 2024-08-17T02:30:26.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc85d3b700 1 -- 172.21.15.155:0/3850855656 learned_addr learned my addr 172.21.15.155:0/3850855656 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:26.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8553a700 1 --2- 172.21.15.155:0/3850855656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 0x7fbc800ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589677760 0 0) 0x7fbc800cd150 con 0x7fbc800b5750 2024-08-17T02:30:26.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc6c003570 con 0x7fbc800b5750 2024-08-17T02:30:26.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078607611 0 0) 0x7fbc80159ce0 con 0x7fbc800b2210 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc800cd150 con 0x7fbc800b2210 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8553a700 1 -- 172.21.15.155:0/3850855656 >> v1:172.21.15.189:6789/0 conn(0x7fbc800b2210 legacy=0x7fbc800b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597544552 0 0) 0x7fbc6c003570 con 0x7fbc800b5750 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8553a700 1 -- 172.21.15.155:0/3850855656 >> v1:172.21.15.155:6789/0 conn(0x7fbc800b5750 legacy=0x7fbc8015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.985+0000 7fbc8553a700 1 -- 172.21.15.155:0/3850855656 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80159fc0 con 0x7fbc800cc840 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8553a700 1 --2- 172.21.15.155:0/3850855656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 0x7fbc800ccc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009910 tx=0x7fbc700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c663d4b2715d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc780017f0 con 0x7fbc800cc840 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70011420 con 0x7fbc800cc840 2024-08-17T02:30:26.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc77fff700 1 -- 172.21.15.155:0/3850855656 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc700117c0 con 0x7fbc800cc840 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- 172.21.15.155:0/3850855656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 msgr2=0x7fbc800ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 --2- 172.21.15.155:0/3850855656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 0x7fbc800ccc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009910 tx=0x7fbc700091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- 172.21.15.155:0/3850855656 shutdown_connections 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 --2- 172.21.15.155:0/3850855656 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800cc840 0x7fbc800ccc10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- 172.21.15.155:0/3850855656 >> 172.21.15.155:0/3850855656 conn(0x7fbc800682c0 msgr2=0x7fbc800686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- 172.21.15.155:0/3850855656 shutdown_connections 2024-08-17T02:30:26.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- 172.21.15.155:0/3850855656 wait complete. 2024-08-17T02:30:26.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 Processor -- start 2024-08-17T02:30:26.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.989+0000 7fbc8779e700 1 -- start start 2024-08-17T02:30:26.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 0x7fbc80151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc800cc840 0x7fbc801544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c8300 con 0x7fbc800b5750 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c85a0 con 0x7fbc800cc840 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c8880 con 0x7fbc800b2210 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40896/0 (socket says 172.21.15.155:40896) 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 -- 172.21.15.155:0/4216491900 learned_addr learned my addr 172.21.15.155:0/4216491900 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8553a700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 0x7fbc80151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc85d3b700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc800cc840 0x7fbc801544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:26.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 -- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 msgr2=0x7fbc80151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 0x7fbc80151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 -- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc800cc840 msgr2=0x7fbc801544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:26.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc800cc840 0x7fbc801544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:26.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 -- 172.21.15.155:0/4216491900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009420 con 0x7fbc800b5750 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8553a700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 0x7fbc80151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc84d39700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c790 tx=0x7fbc7c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c010510 con 0x7fbc800b5750 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c010670 con 0x7fbc800b5750 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc800c8b60 con 0x7fbc800b5750 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c010a10 con 0x7fbc800b5750 2024-08-17T02:30:26.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.993+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc80151f50 con 0x7fbc800b5750 2024-08-17T02:30:26.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc80152200 con 0x7fbc800b5750 2024-08-17T02:30:26.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbc7c01b3b0 con 0x7fbc800b5750 2024-08-17T02:30:26.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc757fa700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 0x7fbc64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:26.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbc7c07c7f0 con 0x7fbc800b5750 2024-08-17T02:30:26.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc8553a700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 0x7fbc64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:26.997+0000 7fbc8553a700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 0x7fbc64062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc700030c0 tx=0x7fbc70016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.005+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbc7c04c850 con 0x7fbc800b5750 2024-08-17T02:30:27.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.169+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.data", "var": "pg_num"} v 0) v1 -- 0x7fbc800645c0 con 0x7fbc800b5750 2024-08-17T02:30:27.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.169+0000 7fbc757fa700 1 -- 172.21.15.155:0/4216491900 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.data", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7fbc7c017020 con 0x7fbc800b5750 2024-08-17T02:30:27.173 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 msgr2=0x7fbc64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 0x7fbc64062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc700030c0 tx=0x7fbc70016000 comp rx=0 tx=0).stop 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 msgr2=0x7fbc801566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00c790 tx=0x7fbc7c007e10 comp rx=0 tx=0).stop 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 shutdown_connections 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbc64060860 0x7fbc64062d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc800cc840 0x7fbc801544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc800b5750 0x7fbc801566c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 --2- 172.21.15.155:0/4216491900 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbc800b2210 0x7fbc80151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 >> 172.21.15.155:0/4216491900 conn(0x7fbc800682c0 msgr2=0x7fbc800cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 shutdown_connections 2024-08-17T02:30:27.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.173+0000 7fbc8779e700 1 -- 172.21.15.155:0/4216491900 wait complete. 2024-08-17T02:30:27.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:27.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 Processor -- start 2024-08-17T02:30:27.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 -- start start 2024-08-17T02:30:27.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f19440aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440adf50 con 0x7f19440ace80 2024-08-17T02:30:27.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440ad340 con 0x7f1944156f80 2024-08-17T02:30:27.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1948ea1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19440ad620 con 0x7f194406f040 2024-08-17T02:30:27.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1941d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f19440ace80 0x7f1944157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46954/0 (socket says 172.21.15.155:46954) 2024-08-17T02:30:27.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1941d9b700 1 -- 172.21.15.155:0/3737877717 learned_addr learned my addr 172.21.15.155:0/3737877717 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:27.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1942d9d700 1 --2- 172.21.15.155:0/3737877717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f19440aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519389466 0 0) 0x7f19440adf50 con 0x7f19440ace80 2024-08-17T02:30:27.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f192c003570 con 0x7f19440ace80 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230843596 0 0) 0x7f19440ad340 con 0x7f1944156f80 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19440adf50 con 0x7f1944156f80 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3827965794 0 0) 0x7f192c003570 con 0x7f19440ace80 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1942d9d700 1 -- 172.21.15.155:0/3737877717 >> v1:172.21.15.189:6789/0 conn(0x7f1944156f80 legacy=0x7f19440ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1942d9d700 1 -- 172.21.15.155:0/3737877717 >> v1:172.21.15.155:6789/0 conn(0x7f19440ace80 legacy=0x7f1944157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1942d9d700 1 -- 172.21.15.155:0/3737877717 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440ad900 con 0x7f194406f040 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f1942d9d700 1 --2- 172.21.15.155:0/3737877717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f19440aab70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f193c009ec0 tx=0x7f193c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d81f1e306577489 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00e070 con 0x7f194406f040 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b870 con 0x7f194406f040 2024-08-17T02:30:27.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.293+0000 7f194159a700 1 -- 172.21.15.155:0/3737877717 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938001470 con 0x7f194406f040 2024-08-17T02:30:27.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- 172.21.15.155:0/3737877717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 msgr2=0x7f19440aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 --2- 172.21.15.155:0/3737877717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f19440aab70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f193c009ec0 tx=0x7f193c009780 comp rx=0 tx=0).stop 2024-08-17T02:30:27.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- 172.21.15.155:0/3737877717 shutdown_connections 2024-08-17T02:30:27.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 --2- 172.21.15.155:0/3737877717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f19440aab70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- 172.21.15.155:0/3737877717 >> 172.21.15.155:0/3737877717 conn(0x7f1944066e00 msgr2=0x7f1944067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- 172.21.15.155:0/3737877717 shutdown_connections 2024-08-17T02:30:27.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- 172.21.15.155:0/3737877717 wait complete. 2024-08-17T02:30:27.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 Processor -- start 2024-08-17T02:30:27.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- start start 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f1944152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1944156f80 0x7f194414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944151bc0 con 0x7f19440ace80 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944153000 con 0x7f1944156f80 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.297+0000 7f1948ea1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944150fb0 con 0x7f194406f040 2024-08-17T02:30:27.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40906/0 (socket says 172.21.15.155:40906) 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 -- 172.21.15.155:0/2508710992 learned_addr learned my addr 172.21.15.155:0/2508710992 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1942d9d700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1944156f80 0x7f194414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f194259c700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f1944152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 -- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 msgr2=0x7f1944152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f1944152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 -- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1944156f80 msgr2=0x7f194414c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1944156f80 0x7f194414c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 -- 172.21.15.155:0/2508710992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009a20 con 0x7f19440ace80 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f194259c700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f1944152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1941d9b700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f193800c990 tx=0x7f1938001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800ce20 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938005b30 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380070f0 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944151290 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1944151850 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.301+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944151d70 con 0x7f19440ace80 2024-08-17T02:30:27.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.305+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f19380074e0 con 0x7f19440ace80 2024-08-17T02:30:27.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.305+0000 7f19327fc700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 0x7f1924062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.305+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f193807ccf0 con 0x7f19440ace80 2024-08-17T02:30:27.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.305+0000 7f194259c700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 0x7f1924062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.305+0000 7f194259c700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 0x7f1924062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19340038f0 tx=0x7f1934009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.309+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1944151d70 con 0x7f19440ace80 2024-08-17T02:30:27.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1944151d70 con 0x7f19440ace80 2024-08-17T02:30:27.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f19327fc700 1 -- 172.21.15.155:0/2508710992 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f1944151d70 con 0x7f19440ace80 2024-08-17T02:30:27.511 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:27.511 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 msgr2=0x7f1924062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 0x7f1924062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19340038f0 tx=0x7f1934009040 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 msgr2=0x7f194414f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.509+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f193800c990 tx=0x7f1938001a20 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 shutdown_connections 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1924060860 0x7f1924062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1944156f80 0x7f194414c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19440ace80 0x7f194414f610 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 --2- 172.21.15.155:0/2508710992 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f194406f040 0x7f1944152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 >> 172.21.15.155:0/2508710992 conn(0x7f1944066e00 msgr2=0x7f19440aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 shutdown_connections 2024-08-17T02:30:27.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.513+0000 7f1948ea1700 1 -- 172.21.15.155:0/2508710992 wait complete. 2024-08-17T02:30:27.515 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-08-17T02:30:27.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:27.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 Processor -- start 2024-08-17T02:30:27.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- start start 2024-08-17T02:30:27.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5918154900 0x7f59180b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f59180b12d0 0x7f59180cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59180b1730 con 0x7f59180cb390 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918068790 con 0x7f5918154900 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59181583f0 con 0x7f59180b12d0 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5918154900 0x7f59180b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5918154900 0x7f59180b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40912/0 (socket says 172.21.15.155:40912) 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 -- 172.21.15.155:0/3104900948 learned_addr learned my addr 172.21.15.155:0/3104900948 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 -- 172.21.15.155:0/3104900948 >> v2:172.21.15.189:3300/0 conn(0x7f59180b12d0 msgr2=0x7f59180cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 --2- 172.21.15.155:0/3104900948 >> v2:172.21.15.189:3300/0 conn(0x7f59180b12d0 0x7f59180cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 -- 172.21.15.155:0/3104900948 >> v1:172.21.15.155:6789/0 conn(0x7f59180cb390 legacy=0x7f591806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 -- 172.21.15.155:0/3104900948 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180cbaa0 con 0x7f5918154900 2024-08-17T02:30:27.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591d48f700 1 --2- 172.21.15.155:0/3104900948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180b0d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f591806f390 tx=0x7f5908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f3a2025857ecb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f5917fff700 1 -- 172.21.15.155:0/3104900948 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800e070 con 0x7f5918154900 2024-08-17T02:30:27.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f5917fff700 1 -- 172.21.15.155:0/3104900948 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590800ba50 con 0x7f5918154900 2024-08-17T02:30:27.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f5917fff700 1 -- 172.21.15.155:0/3104900948 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59080092e0 con 0x7f5918154900 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- 172.21.15.155:0/3104900948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 msgr2=0x7f59180b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 --2- 172.21.15.155:0/3104900948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180b0d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f591806f390 tx=0x7f5908009840 comp rx=0 tx=0).stop 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- 172.21.15.155:0/3104900948 shutdown_connections 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 --2- 172.21.15.155:0/3104900948 >> v2:172.21.15.189:3300/0 conn(0x7f59180b12d0 0x7f59180cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 --2- 172.21.15.155:0/3104900948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180b0d90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- 172.21.15.155:0/3104900948 >> 172.21.15.155:0/3104900948 conn(0x7f59180678d0 msgr2=0x7f5918067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- 172.21.15.155:0/3104900948 shutdown_connections 2024-08-17T02:30:27.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.633+0000 7f591e491700 1 -- 172.21.15.155:0/3104900948 wait complete. 2024-08-17T02:30:27.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 Processor -- start 2024-08-17T02:30:27.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- start start 2024-08-17T02:30:27.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f59180b12d0 0x7f59180aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59180cb390 0x7f5918142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591814e760 con 0x7f5918154900 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180aa7b0 con 0x7f59180cb390 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5918150030 con 0x7f59180b12d0 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591d48f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f59180b12d0 0x7f59180aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40922/0 (socket says 172.21.15.155:40922) 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 -- 172.21.15.155:0/4049178268 learned_addr learned my addr 172.21.15.155:0/4049178268 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591cc8e700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59180cb390 0x7f5918142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 -- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f59180b12d0 msgr2=0x7f59180aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f59180b12d0 0x7f59180aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 -- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59180cb390 msgr2=0x7f5918142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59180cb390 0x7f5918142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 -- 172.21.15.155:0/4049178268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908009ae0 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591dc90700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f591000c560 tx=0x7f5910007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011590 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100116f0 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59180aeb80 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011ab0 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.637+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591814e3f0 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59180643a0 con 0x7f5918154900 2024-08-17T02:30:27.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f591001b3b0 con 0x7f5918154900 2024-08-17T02:30:27.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f59157fa700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 0x7f5904062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f591007c270 con 0x7f5918154900 2024-08-17T02:30:27.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f591d48f700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 0x7f5904062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.641+0000 7f591d48f700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 0x7f5904062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5908009880 tx=0x7f5908018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.649+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f591004c2d0 con 0x7f5918154900 2024-08-17T02:30:27.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.813+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59180b1730 con 0x7f5918154900 2024-08-17T02:30:27.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.813+0000 7f59157fa700 1 -- 172.21.15.155:0/4049178268 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f59180b1730 con 0x7f5918154900 2024-08-17T02:30:27.818 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:27.818 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:29:11.669598+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.17","mappings":[{"from":4,"to":3}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:27.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 msgr2=0x7f5904062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 0x7f5904062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5908009880 tx=0x7f5908018000 comp rx=0 tx=0).stop 2024-08-17T02:30:27.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 msgr2=0x7f59180aa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f591000c560 tx=0x7f5910007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 shutdown_connections 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5904060890 0x7f5904062d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5918154900 0x7f59180aa270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59180cb390 0x7f5918142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 --2- 172.21.15.155:0/4049178268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f59180b12d0 0x7f59180aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 >> 172.21.15.155:0/4049178268 conn(0x7f59180678d0 msgr2=0x7f591806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 shutdown_connections 2024-08-17T02:30:27.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.817+0000 7f591e491700 1 -- 172.21.15.155:0/4049178268 wait complete. 2024-08-17T02:30:27.833 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:27.833 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:27.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.937+0000 7fc54ec34700 1 Processor -- start 2024-08-17T02:30:27.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.937+0000 7fc54ec34700 1 -- start start 2024-08-17T02:30:27.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc548158fb0 0x7fc5480aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 0x7fc54806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc54806e450 0x7fc5480a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54806e8f0 con 0x7fc54806e450 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5480ab2d0 con 0x7fc54815d910 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ab5b0 con 0x7fc548158fb0 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc54806e450 0x7fc5480a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc54806e450 0x7fc5480a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40938/0 (socket says 172.21.15.155:40938) 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 -- 172.21.15.155:0/4173474395 learned_addr learned my addr 172.21.15.155:0/4173474395 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54dc32700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc548158fb0 0x7fc5480aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54d431700 1 --2- 172.21.15.155:0/4173474395 >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 0x7fc54806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 -- 172.21.15.155:0/4173474395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc548158fb0 msgr2=0x7fc5480aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc548158fb0 0x7fc5480aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 -- 172.21.15.155:0/4173474395 >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 msgr2=0x7fc54806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 --2- 172.21.15.155:0/4173474395 >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 0x7fc54806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 -- 172.21.15.155:0/4173474395 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480ab890 con 0x7fc54806e450 2024-08-17T02:30:27.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54d431700 1 --2- 172.21.15.155:0/4173474395 >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 0x7fc54806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:27.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54e433700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5480a9860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc548070f40 tx=0x7fc540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569a33e471224cfb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54cc30700 1 -- 172.21.15.155:0/4173474395 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000b860 con 0x7fc54806e450 2024-08-17T02:30:27.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54cc30700 1 -- 172.21.15.155:0/4173474395 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54000b9c0 con 0x7fc54806e450 2024-08-17T02:30:27.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54cc30700 1 -- 172.21.15.155:0/4173474395 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000bd60 con 0x7fc54806e450 2024-08-17T02:30:27.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- 172.21.15.155:0/4173474395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 msgr2=0x7fc5480a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5480a9860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc548070f40 tx=0x7fc540009250 comp rx=0 tx=0).stop 2024-08-17T02:30:27.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- 172.21.15.155:0/4173474395 shutdown_connections 2024-08-17T02:30:27.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5480a9860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- 172.21.15.155:0/4173474395 >> v2:172.21.15.189:3300/0 conn(0x7fc54815d910 0x7fc54806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 --2- 172.21.15.155:0/4173474395 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc548158fb0 0x7fc5480aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- 172.21.15.155:0/4173474395 >> 172.21.15.155:0/4173474395 conn(0x7fc5480678d0 msgr2=0x7fc548067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- 172.21.15.155:0/4173474395 shutdown_connections 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- 172.21.15.155:0/4173474395 wait complete. 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 Processor -- start 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.941+0000 7fc54ec34700 1 -- start start 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 0x7fc548169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 0x7fc548157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480c8680 con 0x7fc54806e450 2024-08-17T02:30:27.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc548154d20 con 0x7fc548158fb0 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc548169ae0 con 0x7fc54815d910 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40948/0 (socket says 172.21.15.155:40948) 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 -- 172.21.15.155:0/3950151229 learned_addr learned my addr 172.21.15.155:0/3950151229 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54e433700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 0x7fc548157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54d431700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 0x7fc548169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 -- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 msgr2=0x7fc548157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 0x7fc548157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 -- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 msgr2=0x7fc548169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 0x7fc548169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 -- 172.21.15.155:0/3950151229 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400094f0 con 0x7fc54806e450 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54e433700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 0x7fc548157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:27.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54d431700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 0x7fc548169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54dc32700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc53000d890 tx=0x7fc530008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5300125f0 con 0x7fc54806e450 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530012770 con 0x7fc54806e450 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc548169dc0 con 0x7fc54806e450 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012b30 con 0x7fc54806e450 2024-08-17T02:30:27.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5480c8940 con 0x7fc54806e450 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5480c8b90 con 0x7fc54806e450 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc53001e460 con 0x7fc54806e450 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 0x7fc528062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc53007d6e0 con 0x7fc54806e450 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.945+0000 7fc54d431700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 0x7fc528062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:27.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.949+0000 7fc54d431700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 0x7fc528062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5480ae290 tx=0x7fc5380075d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:27.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:27.953+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc53004d740 con 0x7fc54806e450 2024-08-17T02:30:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.149+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5480643a0 con 0x7fc54806e450 2024-08-17T02:30:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.149+0000 7fc545ffb700 1 -- 172.21.15.155:0/3950151229 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5693 (secure 0 0 0) 0x7fc530050d60 con 0x7fc54806e450 2024-08-17T02:30:28.152 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:28.152 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:28.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 msgr2=0x7fc528062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 0x7fc528062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5480ae290 tx=0x7fc5380075d0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 msgr2=0x7fc5481547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc53000d890 tx=0x7fc530008040 comp rx=0 tx=0).stop 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 shutdown_connections 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc528060860 0x7fc528062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc54815d910 0x7fc548157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc548158fb0 0x7fc548169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 --2- 172.21.15.155:0/3950151229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54806e450 0x7fc5481547e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 >> 172.21.15.155:0/3950151229 conn(0x7fc5480678d0 msgr2=0x7fc548152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 shutdown_connections 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.153+0000 7fc54ec34700 1 -- 172.21.15.155:0/3950151229 wait complete. 2024-08-17T02:30:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-08-17T02:30:28.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:28.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 Processor -- start 2024-08-17T02:30:28.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 -- start start 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f974c06aff0 0x7f974c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974c156940 con 0x7f974c0b1660 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974c155d30 con 0x7f974c13e960 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9752615700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974c156010 con 0x7f974c06aff0 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9750e12700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f974c0b1660 0x7f974c13e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46986/0 (socket says 172.21.15.155:46986) 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9750e12700 1 -- 172.21.15.155:0/3792874316 learned_addr learned my addr 172.21.15.155:0/3792874316 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:28.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.261+0000 7f9751613700 1 --2- 172.21.15.155:0/3792874316 >> v2:172.21.15.155:3300/0 conn(0x7f974c06aff0 0x7f974c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257701454 0 0) 0x7f974c156940 con 0x7f974c0b1660 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9738003570 con 0x7f974c0b1660 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821446309 0 0) 0x7f9738003570 con 0x7f974c0b1660 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9751613700 1 -- 172.21.15.155:0/3792874316 >> v1:172.21.15.189:6789/0 conn(0x7f974c13e960 legacy=0x7f974c156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9751613700 1 -- 172.21.15.155:0/3792874316 >> v1:172.21.15.155:6789/0 conn(0x7f974c0b1660 legacy=0x7f974c13e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9751613700 1 -- 172.21.15.155:0/3792874316 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c1562f0 con 0x7f974c06aff0 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9751613700 1 --2- 172.21.15.155:0/3792874316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c06aff0 0x7f974c1556f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f97400098e0 tx=0x7f97400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a627b4f8593bd62 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748001470 con 0x7f974c06aff0 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740011420 con 0x7f974c06aff0 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f973ffff700 1 -- 172.21.15.155:0/3792874316 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400117c0 con 0x7f974c06aff0 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- 172.21.15.155:0/3792874316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c06aff0 msgr2=0x7f974c1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 --2- 172.21.15.155:0/3792874316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c06aff0 0x7f974c1556f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f97400098e0 tx=0x7f97400091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- 172.21.15.155:0/3792874316 shutdown_connections 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 --2- 172.21.15.155:0/3792874316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c06aff0 0x7f974c1556f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- 172.21.15.155:0/3792874316 >> 172.21.15.155:0/3792874316 conn(0x7f974c0678d0 msgr2=0x7f974c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- 172.21.15.155:0/3792874316 shutdown_connections 2024-08-17T02:30:28.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- 172.21.15.155:0/3792874316 wait complete. 2024-08-17T02:30:28.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 Processor -- start 2024-08-17T02:30:28.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.265+0000 7f9752615700 1 -- start start 2024-08-17T02:30:28.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f974c06aff0 0x7f974c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f974c0b1660 0x7f974c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c154300 con 0x7f974c13e960 2024-08-17T02:30:28.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0abcc0 con 0x7f974c0b1660 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0ab990 con 0x7f974c06aff0 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40968/0 (socket says 172.21.15.155:40968) 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9750e12700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f974c0b1660 0x7f974c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 -- 172.21.15.155:0/638251508 learned_addr learned my addr 172.21.15.155:0/638251508 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751613700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f974c06aff0 0x7f974c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 -- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f974c06aff0 msgr2=0x7f974c157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f974c06aff0 0x7f974c157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 -- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f974c0b1660 msgr2=0x7f974c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f974c0b1660 0x7f974c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 -- 172.21.15.155:0/638251508 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009420 con 0x7f974c13e960 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9751e14700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f974400cb90 tx=0x7f97440017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440020e0 con 0x7f974c13e960 2024-08-17T02:30:28.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974400a7a0 con 0x7f974c13e960 2024-08-17T02:30:28.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c124d90 con 0x7f974c13e960 2024-08-17T02:30:28.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974400ab40 con 0x7f974c13e960 2024-08-17T02:30:28.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c125350 con 0x7f974c13e960 2024-08-17T02:30:28.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.269+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c0643a0 con 0x7f974c13e960 2024-08-17T02:30:28.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.273+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9744003030 con 0x7f974c13e960 2024-08-17T02:30:28.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.273+0000 7f973d7fa700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.273+0000 7f9751613700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.273+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f974407d140 con 0x7f974c13e960 2024-08-17T02:30:28.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.273+0000 7f9751613700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 0x7f9730062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97400091e0 tx=0x7f9740017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.281+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f974404d100 con 0x7f974c13e960 2024-08-17T02:30:28.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.481+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f974c0abe00 con 0x7f974c13e960 2024-08-17T02:30:28.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.481+0000 7f973d7fa700 1 -- 172.21.15.155:0/638251508 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f9744050720 con 0x7f974c13e960 2024-08-17T02:30:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:28.485 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:09.299565+0000","modified":"2024-08-17T02:28:12.463328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/2606343357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":2606343357},{"type":"v1","addr":"172.21.15.155:6837","nonce":2606343357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:28.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 msgr2=0x7f9730062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 0x7f9730062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97400091e0 tx=0x7f9740017000 comp rx=0 tx=0).stop 2024-08-17T02:30:28.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 msgr2=0x7f974c153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f974400cb90 tx=0x7f97440017f0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 shutdown_connections 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974c13e960 0x7f974c153dc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f974c0b1660 0x7f974c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 --2- 172.21.15.155:0/638251508 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f974c06aff0 0x7f974c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 >> 172.21.15.155:0/638251508 conn(0x7f974c0678d0 msgr2=0x7f974c158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 shutdown_connections 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.485+0000 7f9752615700 1 -- 172.21.15.155:0/638251508 wait complete. 2024-08-17T02:30:28.488 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-08-17T02:30:28.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:28.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 Processor -- start 2024-08-17T02:30:28.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- start start 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc5d4055870 0x7fc5d404fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5d40523d0 0x7fc5d40527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d404c150 con 0x7fc5d40554a0 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d4051ef0 con 0x7fc5d40523d0 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d40079d0 con 0x7fc5d4055870 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5d40523d0 0x7fc5d40527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5d40523d0 0x7fc5d40527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40976/0 (socket says 172.21.15.155:40976) 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 -- 172.21.15.155:0/2862689305 learned_addr learned my addr 172.21.15.155:0/2862689305 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:28.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5da7fc700 1 --2- 172.21.15.155:0/2862689305 >> v2:172.21.15.189:3300/0 conn(0x7fc5d4055870 0x7fc5d404fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 -- 172.21.15.155:0/2862689305 >> v2:172.21.15.189:3300/0 conn(0x7fc5d4055870 msgr2=0x7fc5d404fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:28.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 --2- 172.21.15.155:0/2862689305 >> v2:172.21.15.189:3300/0 conn(0x7fc5d4055870 0x7fc5d404fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 -- 172.21.15.155:0/2862689305 >> v1:172.21.15.189:6789/0 conn(0x7fc5d40554a0 legacy=0x7fc5d4007fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 -- 172.21.15.155:0/2862689305 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d404a240 con 0x7fc5d40523d0 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5db7fe700 1 --2- 172.21.15.155:0/2862689305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d40523d0 0x7fc5d40527d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc060860 tx=0x7fc5dc064ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a36870cdae0037b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5d9ffb700 1 -- 172.21.15.155:0/2862689305 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc08c070 con 0x7fc5d40523d0 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5d9ffb700 1 -- 172.21.15.155:0/2862689305 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc02b0f0 con 0x7fc5d40523d0 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5d9ffb700 1 -- 172.21.15.155:0/2862689305 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc071530 con 0x7fc5d40523d0 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- 172.21.15.155:0/2862689305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d40523d0 msgr2=0x7fc5d40527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/2862689305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d40523d0 0x7fc5d40527d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc060860 tx=0x7fc5dc064ee0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- 172.21.15.155:0/2862689305 shutdown_connections 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/2862689305 >> v2:172.21.15.189:3300/0 conn(0x7fc5d4055870 0x7fc5d404fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/2862689305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d40523d0 0x7fc5d40527d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- 172.21.15.155:0/2862689305 >> 172.21.15.155:0/2862689305 conn(0x7fc5d4038360 msgr2=0x7fc5d4038760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- 172.21.15.155:0/2862689305 shutdown_connections 2024-08-17T02:30:28.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.601+0000 7fc5dbfff700 1 -- 172.21.15.155:0/2862689305 wait complete. 2024-08-17T02:30:28.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 Processor -- start 2024-08-17T02:30:28.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 -- start start 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5d40523d0 0x7fc5d40e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 0x7fc5d40e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 0x7fc5d40e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4036a70 con 0x7fc5d4055870 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4036d50 con 0x7fc5d40523d0 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5dbfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d4037030 con 0x7fc5d40554a0 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5da7fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 0x7fc5d40e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5db7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 0x7fc5d40e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5da7fc700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 0x7fc5d40e3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:56096/0 (socket says 172.21.15.155:56096) 2024-08-17T02:30:28.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5da7fc700 1 -- 172.21.15.155:0/1200691598 learned_addr learned my addr 172.21.15.155:0/1200691598 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:28.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.605+0000 7fc5daffd700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5d40523d0 0x7fc5d40e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 -- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 msgr2=0x7fc5d40e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 0x7fc5d40e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 -- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5d40523d0 msgr2=0x7fc5d40e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5d40523d0 0x7fc5d40e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 -- 172.21.15.155:0/1200691598 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4037310 con 0x7fc5d4055870 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5db7fe700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 0x7fc5d40e44d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc060be0 tx=0x7fc5dc06e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0708e0 con 0x7fc5d4055870 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc070a40 con 0x7fc5d4055870 2024-08-17T02:30:28.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d40375f0 con 0x7fc5d4055870 2024-08-17T02:30:28.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc070e00 con 0x7fc5d4055870 2024-08-17T02:30:28.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d40e10b0 con 0x7fc5d4055870 2024-08-17T02:30:28.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d40e12a0 con 0x7fc5d4055870 2024-08-17T02:30:28.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc5dc08f070 con 0x7fc5d4055870 2024-08-17T02:30:28.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 0x7fc5c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.609+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc5dc0f6220 con 0x7fc5d4055870 2024-08-17T02:30:28.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.613+0000 7fc5daffd700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 0x7fc5c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.613+0000 7fc5daffd700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 0x7fc5c8062d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc007fd0 tx=0x7fc5cc007eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.617+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc5dc0c61e0 con 0x7fc5d4055870 2024-08-17T02:30:28.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.781+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5d4037780 con 0x7fc5d4055870 2024-08-17T02:30:28.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.781+0000 7fc5c2ffd700 1 -- 172.21.15.155:0/1200691598 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fc5dc0c9800 con 0x7fc5d4055870 2024-08-17T02:30:28.784 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:28.784 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:29:11.669598+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:07.199540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:08.283844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.17","mappings":[{"from":4,"to":3}]},{"pgid":"5.26","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 msgr2=0x7fc5c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 0x7fc5c8062d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc007fd0 tx=0x7fc5cc007eb0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 msgr2=0x7fc5d40e44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 0x7fc5d40e44d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc060be0 tx=0x7fc5dc06e000 comp rx=0 tx=0).stop 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 shutdown_connections 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fc5c8060890 0x7fc5c8062d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5d4055870 0x7fc5d40e44d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc5d40554a0 0x7fc5d40e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 --2- 172.21.15.155:0/1200691598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc5d40523d0 0x7fc5d40e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 >> 172.21.15.155:0/1200691598 conn(0x7fc5d4038360 msgr2=0x7fc5d40062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 shutdown_connections 2024-08-17T02:30:28.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.785+0000 7fc5dbfff700 1 -- 172.21.15.155:0/1200691598 wait complete. 2024-08-17T02:30:28.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:30:28.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.905+0000 7fb243632700 1 Processor -- start 2024-08-17T02:30:28.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.905+0000 7fb243632700 1 -- start start 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb23c155b30 0x7fb23c06eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0c87d0 con 0x7fb23c0aa580 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0ac7d0 con 0x7fb23c155760 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0acab0 con 0x7fb23c155b30 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb241bcf700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb23c0aa580 0x7fb23c0c8c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:46992/0 (socket says 172.21.15.155:46992) 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb241bcf700 1 -- 172.21.15.155:0/343936871 learned_addr learned my addr 172.21.15.155:0/343936871 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb240bcd700 1 --2- 172.21.15.155:0/343936871 >> v2:172.21.15.189:3300/0 conn(0x7fb23c155b30 0x7fb23c06eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467624369 0 0) 0x7fb23c0c87d0 con 0x7fb23c0aa580 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb228003570 con 0x7fb23c0aa580 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153414702 0 0) 0x7fb228003570 con 0x7fb23c0aa580 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 >> v2:172.21.15.189:3300/0 conn(0x7fb23c155b30 msgr2=0x7fb23c06eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 --2- 172.21.15.155:0/343936871 >> v2:172.21.15.189:3300/0 conn(0x7fb23c155b30 0x7fb23c06eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 >> v1:172.21.15.189:6789/0 conn(0x7fb23c155760 legacy=0x7fb23c0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0acd90 con 0x7fb23c0aa580 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7fb234001470 con 0x7fb23c0aa580 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 >> v1:172.21.15.155:6789/0 conn(0x7fb23c0aa580 legacy=0x7fb23c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 0x7fb228003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228004810 0x7fb228004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2280051c0 0x7fb22800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0acab0 con 0x7fb228003a60 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22800c160 con 0x7fb2280051c0 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22800c320 con 0x7fb228004810 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 0x7fb228003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb240bcd700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228004810 0x7fb228004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb241bcf700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2280051c0 0x7fb22800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 -- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228004810 msgr2=0x7fb228004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:28.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228004810 0x7fb228004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 -- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2280051c0 msgr2=0x7fb22800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2280051c0 0x7fb22800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb241bcf700 1 -- 172.21.15.155:0/343936871 reap_dead start 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 -- 172.21.15.155:0/343936871 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228003570 con 0x7fb228003a60 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb240bcd700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228004810 0x7fb228004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb2413ce700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 0x7fb228003e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb22c001360 tx=0x7fb22c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf9448e98262075 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0104a0 con 0x7fb228003a60 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c010620 con 0x7fb228003a60 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb233fff700 1 -- 172.21.15.155:0/343936871 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0107d0 con 0x7fb228003a60 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 -- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 msgr2=0x7fb228003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.909+0000 7fb243632700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 0x7fb228003e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb22c001360 tx=0x7fb22c007d30 comp rx=0 tx=0).stop 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- 172.21.15.155:0/343936871 shutdown_connections 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 --2- 172.21.15.155:0/343936871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb228003a60 0x7fb228003e70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- 172.21.15.155:0/343936871 >> 172.21.15.155:0/343936871 conn(0x7fb23c067810 msgr2=0x7fb23c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:28.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- 172.21.15.155:0/343936871 shutdown_connections 2024-08-17T02:30:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- 172.21.15.155:0/343936871 wait complete. 2024-08-17T02:30:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 Processor -- start 2024-08-17T02:30:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- start start 2024-08-17T02:30:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228003a60 0x7fb23c0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb23c099930 0x7fb23c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c158400 con 0x7fb23c0b1100 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0af300 con 0x7fb23c099930 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb243632700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c157ad0 con 0x7fb228003a60 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40998/0 (socket says 172.21.15.155:40998) 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 -- 172.21.15.155:0/1440217133 learned_addr learned my addr 172.21.15.155:0/1440217133 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb2413ce700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228003a60 0x7fb23c0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb240bcd700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb23c099930 0x7fb23c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 -- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228003a60 msgr2=0x7fb23c0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228003a60 0x7fb23c0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 -- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb23c099930 msgr2=0x7fb23c152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb23c099930 0x7fb23c152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.913+0000 7fb241bcf700 1 -- 172.21.15.155:0/1440217133 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c157db0 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb241bcf700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb23c155fb0 tx=0x7fb234001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400f6c0 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400f820 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400fbc0 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c158090 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c0b1a90 con 0x7fb23c0b1100 2024-08-17T02:30:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c0645c0 con 0x7fb23c0b1100 2024-08-17T02:30:28.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb23401e3b0 con 0x7fb23c0b1100 2024-08-17T02:30:28.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 0x7fb220062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:28.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb23407ca70 con 0x7fb23c0b1100 2024-08-17T02:30:28.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.917+0000 7fb2413ce700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 0x7fb220062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:28.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.921+0000 7fb2413ce700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 0x7fb220062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb22c016000 tx=0x7fb22c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:28.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:28.925+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb23404cb50 con 0x7fb23c0b1100 2024-08-17T02:30:29.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.133+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb23c158540 con 0x7fb23c0b1100 2024-08-17T02:30:29.135 INFO:tasks.ceph.mon.a.smithi155.stderr:2024-08-17T02:30:29.133+0000 7fac07105700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:29.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.141+0000 7fb2317fa700 1 -- 172.21.15.155:0/1440217133 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb23401a070 con 0x7fb23c0b1100 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 msgr2=0x7fb220062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 0x7fb220062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb22c016000 tx=0x7fb22c017000 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 msgr2=0x7fb23c0b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb23c155fb0 tx=0x7fb234001e50 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 shutdown_connections 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb220060860 0x7fb220062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb23c0b1100 0x7fb23c0b1550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb23c099930 0x7fb23c152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 --2- 172.21.15.155:0/1440217133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb228003a60 0x7fb23c0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 >> 172.21.15.155:0/1440217133 conn(0x7fb23c067810 msgr2=0x7fb23c06e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 shutdown_connections 2024-08-17T02:30:29.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.145+0000 7fb243632700 1 -- 172.21.15.155:0/1440217133 wait complete. 2024-08-17T02:30:29.149 INFO:teuthology.orchestra.run.smithi155.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:29.150 INFO:tasks.ceph.mds.a.smithi155.stderr: -7205> 2024-08-17T02:28:14.296+0000 7fcf6227a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:29.160 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:30:29.180 INFO:tasks.ceph.mds.a.smithi155.stdout:starting mds.a at 2024-08-17T02:30:29.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 Processor -- start 2024-08-17T02:30:29.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 -- start start 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd8641514d0 0x7fd86406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406e010 con 0x7fd8640b14a0 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406efa0 con 0x7fd8641574f0 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd86359e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd864157fb0 con 0x7fd8641514d0 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd862d9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd8640b14a0 0x7fd8640c96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47008/0 (socket says 172.21.15.155:47008) 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.261+0000 7fd862d9d700 1 -- 172.21.15.155:0/2892618319 learned_addr learned my addr 172.21.15.155:0/2892618319 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86259c700 1 --2- 172.21.15.155:0/2892618319 >> v2:172.21.15.189:3300/0 conn(0x7fd8641514d0 0x7fd86406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:29.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86159a700 1 -- 172.21.15.155:0/2892618319 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598476934 0 0) 0x7fd86406e010 con 0x7fd8640b14a0 2024-08-17T02:30:29.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86159a700 1 -- 172.21.15.155:0/2892618319 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd84c003570 con 0x7fd8640b14a0 2024-08-17T02:30:29.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86259c700 1 -- 172.21.15.155:0/2892618319 >> v1:172.21.15.189:6789/0 conn(0x7fd8641574f0 legacy=0x7fd8640b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86259c700 1 -- 172.21.15.155:0/2892618319 >> v1:172.21.15.155:6789/0 conn(0x7fd8640b14a0 legacy=0x7fd8640c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86259c700 1 -- 172.21.15.155:0/2892618319 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864158290 con 0x7fd8641514d0 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86259c700 1 --2- 172.21.15.155:0/2892618319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd86406ea60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009e60 tx=0x7fd85c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb505ca0c4c1747 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86159a700 1 -- 172.21.15.155:0/2892618319 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00e070 con 0x7fd8641514d0 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86159a700 1 -- 172.21.15.155:0/2892618319 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00bb60 con 0x7fd8641514d0 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86159a700 1 -- 172.21.15.155:0/2892618319 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c012430 con 0x7fd8641514d0 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 -- 172.21.15.155:0/2892618319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 msgr2=0x7fd86406ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 --2- 172.21.15.155:0/2892618319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd86406ea60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009e60 tx=0x7fd85c009780 comp rx=0 tx=0).stop 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 -- 172.21.15.155:0/2892618319 shutdown_connections 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 --2- 172.21.15.155:0/2892618319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd86406ea60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 -- 172.21.15.155:0/2892618319 >> 172.21.15.155:0/2892618319 conn(0x7fd8640678a0 msgr2=0x7fd864067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 -- 172.21.15.155:0/2892618319 shutdown_connections 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 -- 172.21.15.155:0/2892618319 wait complete. 2024-08-17T02:30:29.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.265+0000 7fd86359e700 1 Processor -- start 2024-08-17T02:30:29.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- start start 2024-08-17T02:30:29.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd8640b14a0 0x7fd8640afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:29.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd8640acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:29.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:29.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640a9d50 con 0x7fd8641574f0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b0640 con 0x7fd8641514d0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b0920 con 0x7fd8640b14a0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41014/0 (socket says 172.21.15.155:41014) 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 -- 172.21.15.155:0/1392502364 learned_addr learned my addr 172.21.15.155:0/1392502364 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86259c700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd8640b14a0 0x7fd8640afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd861d9b700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd8640acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 -- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd8640b14a0 msgr2=0x7fd8640afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd8640b14a0 0x7fd8640afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 -- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 msgr2=0x7fd8640acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd8640acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 -- 172.21.15.155:0/1392502364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009a20 con 0x7fd8641574f0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd861d9b700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd8640acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd862d9d700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd8540058d0 tx=0x7fd854007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854005b30 con 0x7fd8641574f0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640a99e0 con 0x7fd8641574f0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854005c90 con 0x7fd8641574f0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540072e0 con 0x7fd8641574f0 2024-08-17T02:30:29.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.269+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8640ad190 con 0x7fd8641574f0 2024-08-17T02:30:29.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864064330 con 0x7fd8641574f0 2024-08-17T02:30:29.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd854007690 con 0x7fd8641574f0 2024-08-17T02:30:29.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd8527fc700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 0x7fd844062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:29.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fd85407c360 con 0x7fd8641574f0 2024-08-17T02:30:29.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd86259c700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 0x7fd844062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:29.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.273+0000 7fd86259c700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 0x7fd844062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0099f0 tx=0x7fd85c019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:29.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.277+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd85404c370 con 0x7fd8641574f0 2024-08-17T02:30:29.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:29.477+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd864155860 con 0x7fd8641574f0 2024-08-17T02:30:30.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.181+0000 7fd8527fc700 1 -- 172.21.15.155:0/1392502364 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd85404f990 con 0x7fd8641574f0 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 msgr2=0x7fd844062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 0x7fd844062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0099f0 tx=0x7fd85c019000 comp rx=0 tx=0).stop 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 msgr2=0x7fd864146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd8540058d0 tx=0x7fd854007d30 comp rx=0 tx=0).stop 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 shutdown_connections 2024-08-17T02:30:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd844060860 0x7fd844062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8641574f0 0x7fd864146210 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8641514d0 0x7fd8640acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 --2- 172.21.15.155:0/1392502364 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd8640b14a0 0x7fd8640afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 >> 172.21.15.155:0/1392502364 conn(0x7fd8640678a0 msgr2=0x7fd8641506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 shutdown_connections 2024-08-17T02:30:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.185+0000 7fd86359e700 1 -- 172.21.15.155:0/1392502364 wait complete. 2024-08-17T02:30:30.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:30:30.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 Processor -- start 2024-08-17T02:30:30.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 -- start start 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05a8140730 0x7f05a80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a80ac060 con 0x7f05a8140360 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a806dbf0 con 0x7f05a80abc00 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05ad782700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a80ae820 con 0x7f05a8140730 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a77fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05a8140730 0x7f05a80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a7fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f05a8140360 0x7f05a80aee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47012/0 (socket says 172.21.15.155:47012) 2024-08-17T02:30:30.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a7fff700 1 -- 172.21.15.155:0/3347061754 learned_addr learned my addr 172.21.15.155:0/3347061754 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:30.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a77fe700 1 -- 172.21.15.155:0/3347061754 >> v1:172.21.15.189:6789/0 conn(0x7f05a80abc00 legacy=0x7f05a80ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a77fe700 1 -- 172.21.15.155:0/3347061754 >> v1:172.21.15.155:6789/0 conn(0x7f05a8140360 legacy=0x7f05a80aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a77fe700 1 -- 172.21.15.155:0/3347061754 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a806d2c0 con 0x7f05a8140730 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a6ffd700 1 -- 172.21.15.155:0/3347061754 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210170743 0 0) 0x7f0598001110 con 0x7f05a8140360 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a77fe700 1 --2- 172.21.15.155:0/3347061754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a80ab6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05900098e0 tx=0x7f05900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d4e7b53a1d3f52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a6ffd700 1 -- 172.21.15.155:0/3347061754 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590009e80 con 0x7f05a8140730 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a6ffd700 1 -- 172.21.15.155:0/3347061754 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000b860 con 0x7f05a8140730 2024-08-17T02:30:30.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.321+0000 7f05a6ffd700 1 -- 172.21.15.155:0/3347061754 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000bbe0 con 0x7f05a8140730 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- 172.21.15.155:0/3347061754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 msgr2=0x7f05a80ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 --2- 172.21.15.155:0/3347061754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a80ab6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05900098e0 tx=0x7f05900091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- 172.21.15.155:0/3347061754 shutdown_connections 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 --2- 172.21.15.155:0/3347061754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a80ab6c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- 172.21.15.155:0/3347061754 >> 172.21.15.155:0/3347061754 conn(0x7f05a8066e00 msgr2=0x7f05a8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- 172.21.15.155:0/3347061754 shutdown_connections 2024-08-17T02:30:30.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- 172.21.15.155:0/3347061754 wait complete. 2024-08-17T02:30:30.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 Processor -- start 2024-08-17T02:30:30.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- start start 2024-08-17T02:30:30.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a80abc00 0x7f05a815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05a8140360 0x7f05a80671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8160370 con 0x7f05a8140730 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8159b50 con 0x7f05a80abc00 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05ad782700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a815e250 con 0x7f05a8140360 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05acf81700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05acf81700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41040/0 (socket says 172.21.15.155:41040) 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05acf81700 1 -- 172.21.15.155:0/571380810 learned_addr learned my addr 172.21.15.155:0/571380810 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05a7fff700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a80abc00 0x7f05a815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.325+0000 7f05a77fe700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05a8140360 0x7f05a80671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 -- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05a8140360 msgr2=0x7f05a80671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05a8140360 0x7f05a80671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 -- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a80abc00 msgr2=0x7f05a815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a80abc00 0x7f05a815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 -- 172.21.15.155:0/571380810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009420 con 0x7f05a8140730 2024-08-17T02:30:30.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05acf81700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c910 tx=0x7f05a0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0012630 con 0x7f05a8140730 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0012790 con 0x7f05a8140730 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0012b50 con 0x7f05a8140730 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a816e970 con 0x7f05a8140730 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a81597e0 con 0x7f05a8140730 2024-08-17T02:30:30.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a8159ce0 con 0x7f05a8140730 2024-08-17T02:30:30.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.329+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f05a001a3a0 con 0x7f05a8140730 2024-08-17T02:30:30.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.333+0000 7f059ffff700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.333+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f05a007d310 con 0x7f05a8140730 2024-08-17T02:30:30.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.333+0000 7f05a7fff700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.333+0000 7f05a7fff700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 0x7f0588062d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598007b70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.337+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f05a004d270 con 0x7f05a8140730 2024-08-17T02:30:30.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:30.505+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05a80644b0 con 0x7f05a8140730 2024-08-17T02:30:31.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.193+0000 7f059ffff700 1 -- 172.21.15.155:0/571380810 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f05a0050890 con 0x7f05a8140730 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 msgr2=0x7f0588062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 0x7f0588062d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0598000c00 tx=0x7f0598007b70 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 msgr2=0x7f05a8067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c910 tx=0x7f05a0001710 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 shutdown_connections 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a8140730 0x7f05a8067710 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f05a8140360 0x7f05a80671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 --2- 172.21.15.155:0/571380810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a80abc00 0x7f05a815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 >> 172.21.15.155:0/571380810 conn(0x7f05a8066e00 msgr2=0x7f05a806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 shutdown_connections 2024-08-17T02:30:31.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.197+0000 7f05ad782700 1 -- 172.21.15.155:0/571380810 wait complete. 2024-08-17T02:30:31.202 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:30:31.219 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:30:31.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.333+0000 7f43b61e1700 1 Processor -- start 2024-08-17T02:30:31.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.333+0000 7f43b61e1700 1 -- start start 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b61e1700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43b006d120 0x7f43b00ad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b61e1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43b00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b61e1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00ca0b0 con 0x7f43b0157050 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b61e1700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b00ae300 con 0x7f43b006d120 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b61e1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b006d5a0 con 0x7f43b00ade80 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f43b0157050 0x7f43b00ac0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47024/0 (socket says 172.21.15.155:47024) 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 -- 172.21.15.155:0/2387372763 learned_addr learned my addr 172.21.15.155:0/2387372763 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b59e0700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43b00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b49de700 1 --2- 172.21.15.155:0/2387372763 >> v2:172.21.15.189:3300/0 conn(0x7f43b006d120 0x7f43b00ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290921860 0 0) 0x7f43b00ca0b0 con 0x7f43b0157050 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4398003570 con 0x7f43b0157050 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341076135 0 0) 0x7f4398003570 con 0x7f43b0157050 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 msgr2=0x7f43b00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43b00ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 >> v2:172.21.15.189:3300/0 conn(0x7f43b006d120 msgr2=0x7f43b00ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 --2- 172.21.15.155:0/2387372763 >> v2:172.21.15.189:3300/0 conn(0x7f43b006d120 0x7f43b00ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00c97c0 con 0x7f43b0157050 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4198757473 0 0) 0x7f43a0001470 con 0x7f43b0157050 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 >> v1:172.21.15.155:6789/0 conn(0x7f43b0157050 legacy=0x7f43b00ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4398003a60 0x7f4398003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4398004810 0x7f4398004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00ae300 con 0x7f4398003a60 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b006d5a0 con 0x7f4398004810 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4398003a60 0x7f4398003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439800ba60 con 0x7f43b00ade80 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b49de700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4398004810 0x7f4398004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b59e0700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 -- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 msgr2=0x7f43980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b00ade80 0x7f43980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 -- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4398004810 msgr2=0x7f4398004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4398004810 0x7f4398004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 -- 172.21.15.155:0/2387372763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398003570 con 0x7f4398003a60 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43b51df700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4398003a60 0x7f4398003e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f43a000c3f0 tx=0x7f43a0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819c5671f76f61cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000cc80 con 0x7f4398003a60 2024-08-17T02:30:31.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000ce00 con 0x7f4398003a60 2024-08-17T02:30:31.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.337+0000 7f43a7fff700 1 -- 172.21.15.155:0/2387372763 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0005b70 con 0x7f4398003a60 2024-08-17T02:30:31.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- 172.21.15.155:0/2387372763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4398003a60 msgr2=0x7f4398003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 --2- 172.21.15.155:0/2387372763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4398003a60 0x7f4398003e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f43a000c3f0 tx=0x7f43a0001e90 comp rx=0 tx=0).stop 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b59e0700 1 -- 172.21.15.155:0/2387372763 reap_dead start 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- 172.21.15.155:0/2387372763 shutdown_connections 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- 172.21.15.155:0/2387372763 >> 172.21.15.155:0/2387372763 conn(0x7f43b0066e00 msgr2=0x7f43b0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- 172.21.15.155:0/2387372763 shutdown_connections 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- 172.21.15.155:0/2387372763 wait complete. 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 Processor -- start 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- start start 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 0x7f43b015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b0145cd0 0x7f43b00aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015a070 con 0x7f43b01596b0 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00ac250 con 0x7f43b0145900 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b61e1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00ab940 con 0x7f43b0145cd0 2024-08-17T02:30:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b59e0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b59e0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41054/0 (socket says 172.21.15.155:41054) 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b59e0700 1 -- 172.21.15.155:0/494368948 learned_addr learned my addr 172.21.15.155:0/494368948 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b49de700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b0145cd0 0x7f43b00aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.341+0000 7f43b51df700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 0x7f43b015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 -- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b0145cd0 msgr2=0x7f43b00aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b0145cd0 0x7f43b00aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 -- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 msgr2=0x7f43b015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 0x7f43b015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 -- 172.21.15.155:0/494368948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00aa9a0 con 0x7f43b01596b0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b51df700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 0x7f43b015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b59e0700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43b0064e00 tx=0x7f43a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800f700 con 0x7f43b01596b0 2024-08-17T02:30:31.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800f860 con 0x7f43b01596b0 2024-08-17T02:30:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b00abc00 con 0x7f43b01596b0 2024-08-17T02:30:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a800fbe0 con 0x7f43b01596b0 2024-08-17T02:30:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b00aeed0 con 0x7f43b01596b0 2024-08-17T02:30:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00644b0 con 0x7f43b01596b0 2024-08-17T02:30:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.345+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f43a8014440 con 0x7f43b01596b0 2024-08-17T02:30:31.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.349+0000 7f43a57fa700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.349+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6367+0+0 (secure 0 0 0) 0x7f43a807d3b0 con 0x7f43b01596b0 2024-08-17T02:30:31.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.349+0000 7f43b51df700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.349+0000 7f43b51df700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 0x7f439c062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43b006b5e0 tx=0x7f43a0015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.357+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f43a804d570 con 0x7f43b01596b0 2024-08-17T02:30:31.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:31.521+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43b006eff0 con 0x7f43b01596b0 2024-08-17T02:30:32.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.197+0000 7f43a57fa700 1 -- 172.21.15.155:0/494368948 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f43a8050b90 con 0x7f43b01596b0 2024-08-17T02:30:32.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 msgr2=0x7f439c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 0x7f439c062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43b006b5e0 tx=0x7f43a0015000 comp rx=0 tx=0).stop 2024-08-17T02:30:32.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 msgr2=0x7f43b0159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43b0064e00 tx=0x7f43a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 shutdown_connections 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b01596b0 0x7f43b0159b30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43b0145cd0 0x7f43b00aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 --2- 172.21.15.155:0/494368948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b0145900 0x7f43b015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 >> 172.21.15.155:0/494368948 conn(0x7f43b0066e00 msgr2=0x7f43b00c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 shutdown_connections 2024-08-17T02:30:32.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.209+0000 7f43b61e1700 1 -- 172.21.15.155:0/494368948 wait complete. 2024-08-17T02:30:32.213 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' removed 2024-08-17T02:30:32.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:32.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 Processor -- start 2024-08-17T02:30:32.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- start start 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 0x7fce980af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce9806e830 0x7fce980a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce980b0270 con 0x7fce980a9260 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980af660 con 0x7fce9806e830 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce980af940 con 0x7fce9815d540 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce9806e830 0x7fce980a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce9806e830 0x7fce980a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41068/0 (socket says 172.21.15.155:41068) 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 -- 172.21.15.155:0/3804561840 learned_addr learned my addr 172.21.15.155:0/3804561840 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9dfe2700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 0x7fce980af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 -- 172.21.15.155:0/3804561840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 msgr2=0x7fce980af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 0x7fce980af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 -- 172.21.15.155:0/3804561840 >> v1:172.21.15.155:6789/0 conn(0x7fce980a9260 legacy=0x7fce980b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 -- 172.21.15.155:0/3804561840 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980afc20 con 0x7fce9806e830 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9dfe2700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 0x7fce980af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9d7e1700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9806e830 0x7fce980a8d20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce90009f20 tx=0x7fce90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7db30618f3dc59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9cfe0700 1 -- 172.21.15.155:0/3804561840 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000e070 con 0x7fce9806e830 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9cfe0700 1 -- 172.21.15.155:0/3804561840 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9000ba80 con 0x7fce9806e830 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fce9cfe0700 1 -- 172.21.15.155:0/3804561840 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900092e0 con 0x7fce9806e830 2024-08-17T02:30:32.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- 172.21.15.155:0/3804561840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9806e830 msgr2=0x7fce980a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9806e830 0x7fce980a8d20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce90009f20 tx=0x7fce90009840 comp rx=0 tx=0).stop 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- 172.21.15.155:0/3804561840 shutdown_connections 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9806e830 0x7fce980a8d20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 --2- 172.21.15.155:0/3804561840 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9815d540 0x7fce980af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- 172.21.15.155:0/3804561840 >> 172.21.15.155:0/3804561840 conn(0x7fce98066e00 msgr2=0x7fce98067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- 172.21.15.155:0/3804561840 shutdown_connections 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.325+0000 7fcea0246700 1 -- 172.21.15.155:0/3804561840 wait complete. 2024-08-17T02:30:32.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 Processor -- start 2024-08-17T02:30:32.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- start start 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9806e830 0x7fce981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce980a9260 0x7fce9815e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98159600 con 0x7fce9815d540 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9816e050 con 0x7fce980a9260 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98158b30 con 0x7fce9806e830 2024-08-17T02:30:32.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41084/0 (socket says 172.21.15.155:41084) 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 -- 172.21.15.155:0/1315269129 learned_addr learned my addr 172.21.15.155:0/1315269129 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9dfe2700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9806e830 0x7fce981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9d7e1700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce980a9260 0x7fce9815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 -- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9806e830 msgr2=0x7fce981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9806e830 0x7fce981585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 -- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce980a9260 msgr2=0x7fce9815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce980a9260 0x7fce9815e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 -- 172.21.15.155:0/1315269129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90009ae0 con 0x7fce9815d540 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce9e7e3700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c560 tx=0x7fce88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88011590 con 0x7fce9815d540 2024-08-17T02:30:32.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880116f0 con 0x7fce9815d540 2024-08-17T02:30:32.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce980ca7c0 con 0x7fce9815d540 2024-08-17T02:30:32.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88011ab0 con 0x7fce9815d540 2024-08-17T02:30:32.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.329+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9816dd60 con 0x7fce9815d540 2024-08-17T02:30:32.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce980645c0 con 0x7fce9815d540 2024-08-17T02:30:32.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fce8801b3b0 con 0x7fce9815d540 2024-08-17T02:30:32.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fce8dffb700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 0x7fce7c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fce8807c170 con 0x7fce9815d540 2024-08-17T02:30:32.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fce9dfe2700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 0x7fce7c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.333+0000 7fce9dfe2700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 0x7fce7c062d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce94006fd0 tx=0x7fce94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.341+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fce8804c540 con 0x7fce9815d540 2024-08-17T02:30:32.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.505+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce9816e190 con 0x7fce9815d540 2024-08-17T02:30:32.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fce8dffb700 1 -- 172.21.15.155:0/1315269129 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fce8804fb60 con 0x7fce9815d540 2024-08-17T02:30:32.510 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:32.511 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":41,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:30:32.191352+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6837/2606343357":"2024-08-18T02:30:29.135388+0000","172.21.15.155:6836/2606343357":"2024-08-18T02:30:29.135388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 msgr2=0x7fce7c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 0x7fce7c062d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce94006fd0 tx=0x7fce94008040 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 msgr2=0x7fce9815ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c560 tx=0x7fce88007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 shutdown_connections 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fce7c060890 0x7fce7c062d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce9815d540 0x7fce9815ee20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce980a9260 0x7fce9815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 --2- 172.21.15.155:0/1315269129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fce9806e830 0x7fce981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 >> 172.21.15.155:0/1315269129 conn(0x7fce98066e00 msgr2=0x7fce98069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 shutdown_connections 2024-08-17T02:30:32.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.509+0000 7fcea0246700 1 -- 172.21.15.155:0/1315269129 wait complete. 2024-08-17T02:30:32.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:15.998578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000005383.meta', 'create_time': '2024-08-17T02:28:21.542725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000005383'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000005383.data', 'create_time': '2024-08-17T02:28:21.639804+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000005383'}}}] 2024-08-17T02:30:32.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 Processor -- start 2024-08-17T02:30:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- start start 2024-08-17T02:30:32.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7654140a30 0x7f76540c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140e00 0x7f76540cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540c3b90 con 0x7f76540b0e30 2024-08-17T02:30:32.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540ca510 con 0x7f7654140a30 2024-08-17T02:30:32.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540ca7f0 con 0x7f7654140e00 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7654140a30 0x7f76540c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7654140a30 0x7f76540c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41100/0 (socket says 172.21.15.155:41100) 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 -- 172.21.15.155:0/2771482021 learned_addr learned my addr 172.21.15.155:0/2771482021 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f7658b3c700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140e00 0x7f76540cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 -- 172.21.15.155:0/2771482021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140e00 msgr2=0x7f76540cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140e00 0x7f76540cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 -- 172.21.15.155:0/2771482021 >> v1:172.21.15.155:6789/0 conn(0x7f76540b0e30 legacy=0x7f76540cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 -- 172.21.15.155:0/2771482021 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540c37d0 con 0x7f7654140a30 2024-08-17T02:30:32.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765933d700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7654140a30 0x7f76540c86b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f76500099e0 tx=0x7f7650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19993906cea5ca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f764bfff700 1 -- 172.21.15.155:0/2771482021 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000b820 con 0x7f7654140a30 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f764bfff700 1 -- 172.21.15.155:0/2771482021 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000b980 con 0x7f7654140a30 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f764bfff700 1 -- 172.21.15.155:0/2771482021 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000bd20 con 0x7f7654140a30 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- 172.21.15.155:0/2771482021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7654140a30 msgr2=0x7f76540c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7654140a30 0x7f76540c86b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f76500099e0 tx=0x7f7650009250 comp rx=0 tx=0).stop 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- 172.21.15.155:0/2771482021 shutdown_connections 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140e00 0x7f76540cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 --2- 172.21.15.155:0/2771482021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7654140a30 0x7f76540c86b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.637+0000 7f765b5a1700 1 -- 172.21.15.155:0/2771482021 >> 172.21.15.155:0/2771482021 conn(0x7f76540caae0 msgr2=0x7f76540caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- 172.21.15.155:0/2771482021 shutdown_connections 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- 172.21.15.155:0/2771482021 wait complete. 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 Processor -- start 2024-08-17T02:30:32.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- start start 2024-08-17T02:30:32.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140a30 0x7f765415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7654140e00 0x7f765415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7654069640 con 0x7f76540b0e30 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765415d900 con 0x7f7654140e00 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540698e0 con 0x7f7654140a30 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41116/0 (socket says 172.21.15.155:41116) 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f7658b3c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140a30 0x7f765415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 -- 172.21.15.155:0/362132055 learned_addr learned my addr 172.21.15.155:0/362132055 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f7659b3e700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7654140e00 0x7f765415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 -- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140a30 msgr2=0x7f765415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140a30 0x7f765415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 -- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7654140e00 msgr2=0x7f765415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7654140e00 0x7f765415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 -- 172.21.15.155:0/362132055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094f0 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765933d700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f765000b3c0 tx=0x7f7650017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011dd0 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765406b020 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765415d340 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650024650 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.641+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500247c0 con 0x7f76540b0e30 2024-08-17T02:30:32.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.645+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76340052b0 con 0x7f76540b0e30 2024-08-17T02:30:32.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.645+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7650024920 con 0x7f76540b0e30 2024-08-17T02:30:32.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.645+0000 7f76497fa700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 0x7f7638062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.645+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f765007e460 con 0x7f76540b0e30 2024-08-17T02:30:32.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.645+0000 7f7658b3c700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 0x7f7638062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.650 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.649+0000 7f7658b3c700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 0x7f7638062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7654160110 tx=0x7f7644008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.653+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f765004e790 con 0x7f76540b0e30 2024-08-17T02:30:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.813+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7634005ae0 con 0x7f76540b0e30 2024-08-17T02:30:32.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.813+0000 7f76497fa700 1 -- 172.21.15.155:0/362132055 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7650051db0 con 0x7f76540b0e30 2024-08-17T02:30:32.816 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 msgr2=0x7f7638062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 0x7f7638062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7654160110 tx=0x7f7644008040 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 msgr2=0x7f76540afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f765000b3c0 tx=0x7f7650017000 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 shutdown_connections 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7638060860 0x7f7638062d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7654140e00 0x7f765415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7654140a30 0x7f765415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 --2- 172.21.15.155:0/362132055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76540b0e30 0x7f76540afd20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 >> 172.21.15.155:0/362132055 conn(0x7f76540caae0 msgr2=0x7f7654159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 shutdown_connections 2024-08-17T02:30:32.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:32.817+0000 7f765b5a1700 1 -- 172.21.15.155:0/362132055 wait complete. 2024-08-17T02:30:32.821 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:32.823 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:32.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000005383.meta pg_num 2024-08-17T02:30:33.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.021+0000 7f66c1078700 1 Processor -- start 2024-08-17T02:30:33.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.021+0000 7f66c1078700 1 -- start start 2024-08-17T02:30:33.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 0x7f66bc069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f66bc156000 0x7f66bc069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc13be40 con 0x7f66bc13a4c0 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc13b010 con 0x7f66bc156000 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc13d930 con 0x7f66bc155c30 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c0877700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f66bc13a4c0 0x7f66bc13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47060/0 (socket says 172.21.15.155:47060) 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c0877700 1 -- 172.21.15.155:0/934711552 learned_addr learned my addr 172.21.15.155:0/934711552 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 --2- 172.21.15.155:0/934711552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 0x7f66bc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bb7fe700 1 --2- 172.21.15.155:0/934711552 >> v2:172.21.15.189:3300/0 conn(0x7f66bc156000 0x7f66bc069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785188343 0 0) 0x7f66bc13be40 con 0x7f66bc13a4c0 2024-08-17T02:30:33.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f669c003570 con 0x7f66bc13a4c0 2024-08-17T02:30:33.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 -- 172.21.15.155:0/934711552 >> v2:172.21.15.189:3300/0 conn(0x7f66bc156000 msgr2=0x7f66bc069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 --2- 172.21.15.155:0/934711552 >> v2:172.21.15.189:3300/0 conn(0x7f66bc156000 0x7f66bc069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 -- 172.21.15.155:0/934711552 >> v1:172.21.15.155:6789/0 conn(0x7f66bc13a4c0 legacy=0x7f66bc13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500887074 0 0) 0x7f669c003570 con 0x7f66bc13a4c0 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 -- 172.21.15.155:0/934711552 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc13b230 con 0x7f66bc155c30 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66bbfff700 1 --2- 172.21.15.155:0/934711552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 0x7f66bc069930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0098e0 tx=0x7f66ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8ce9177c041ee2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40017f0 con 0x7f66bc155c30 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac011420 con 0x7f66bc155c30 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66baffd700 1 -- 172.21.15.155:0/934711552 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0117c0 con 0x7f66bc155c30 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- 172.21.15.155:0/934711552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 msgr2=0x7f66bc069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 --2- 172.21.15.155:0/934711552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 0x7f66bc069930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0098e0 tx=0x7f66ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- 172.21.15.155:0/934711552 shutdown_connections 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 --2- 172.21.15.155:0/934711552 >> v2:172.21.15.189:3300/0 conn(0x7f66bc156000 0x7f66bc069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 --2- 172.21.15.155:0/934711552 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc155c30 0x7f66bc069930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- 172.21.15.155:0/934711552 >> 172.21.15.155:0/934711552 conn(0x7f66bc06e170 msgr2=0x7f66bc06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- 172.21.15.155:0/934711552 shutdown_connections 2024-08-17T02:30:33.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.025+0000 7f66c1078700 1 -- 172.21.15.155:0/934711552 wait complete. 2024-08-17T02:30:33.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 Processor -- start 2024-08-17T02:30:33.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 -- start start 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66bc13a4c0 0x7f66bc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc156000 0x7f66bc165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc151db0 con 0x7f66bc0af5f0 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0cc4c0 con 0x7f66bc13a4c0 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c1078700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0cb940 con 0x7f66bc156000 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c0877700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c0877700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41130/0 (socket says 172.21.15.155:41130) 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66c0877700 1 -- 172.21.15.155:0/4294674415 learned_addr learned my addr 172.21.15.155:0/4294674415 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66bbfff700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66bc13a4c0 0x7f66bc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.029+0000 7f66bb7fe700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc156000 0x7f66bc165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 -- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc156000 msgr2=0x7f66bc165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc156000 0x7f66bc165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 -- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66bc13a4c0 msgr2=0x7f66bc0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66bc13a4c0 0x7f66bc0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 -- 172.21.15.155:0/4294674415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009420 con 0x7f66bc0af5f0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c0877700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f66b400cc20 tx=0x7f66b4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004dc0 con 0x7f66bc0af5f0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b400a6a0 con 0x7f66bc0af5f0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0cbc20 con 0x7f66bc0af5f0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400aa40 con 0x7f66bc0af5f0 2024-08-17T02:30:33.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc0cc1e0 con 0x7f66bc0af5f0 2024-08-17T02:30:33.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc070080 con 0x7f66bc0af5f0 2024-08-17T02:30:33.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f66b4007150 con 0x7f66bc0af5f0 2024-08-17T02:30:33.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 0x7f66a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f66b407c710 con 0x7f66bc0af5f0 2024-08-17T02:30:33.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.033+0000 7f66bbfff700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 0x7f66a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.037+0000 7f66bbfff700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 0x7f66a0062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66bc064d10 tx=0x7f66ac016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.041+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f66bc070080 con 0x7f66bc0af5f0 2024-08-17T02:30:33.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.209+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.meta", "var": "pg_num"} v 0) v1 -- 0x7f66bc070080 con 0x7f66bc0af5f0 2024-08-17T02:30:33.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.213+0000 7f66b3fff700 1 -- 172.21.15.155:0/4294674415 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7f66bc070080 con 0x7f66bc0af5f0 2024-08-17T02:30:33.216 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:30:33.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 msgr2=0x7f66a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 0x7f66a0062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66bc064d10 tx=0x7f66ac016000 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 msgr2=0x7f66bc165990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f66b400cc20 tx=0x7f66b4001640 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 shutdown_connections 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f66a0060860 0x7f66a0062d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66bc0af5f0 0x7f66bc165990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f66bc156000 0x7f66bc165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 --2- 172.21.15.155:0/4294674415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66bc13a4c0 0x7f66bc0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 >> 172.21.15.155:0/4294674415 conn(0x7f66bc06e170 msgr2=0x7f66bc154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 shutdown_connections 2024-08-17T02:30:33.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.217+0000 7f66c1078700 1 -- 172.21.15.155:0/4294674415 wait complete. 2024-08-17T02:30:33.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000005383.data pg_num 2024-08-17T02:30:33.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 Processor -- start 2024-08-17T02:30:33.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 -- start start 2024-08-17T02:30:33.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fca5806ee10 0x7fca580ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca580aebe0 0x7fca580b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580ad090 con 0x7fca58142940 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580ad330 con 0x7fca580aebe0 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5759e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580ad610 con 0x7fca5806ee10 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca56d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca580aebe0 0x7fca580b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5659c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fca58142940 0x7fca5806e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:47068/0 (socket says 172.21.15.155:47068) 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.337+0000 7fca5659c700 1 -- 172.21.15.155:0/718160843 learned_addr learned my addr 172.21.15.155:0/718160843 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:33.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca4dd9b700 1 --2- 172.21.15.155:0/718160843 >> v2:172.21.15.189:3300/0 conn(0x7fca5806ee10 0x7fca580ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca56d9d700 1 -- 172.21.15.155:0/718160843 >> v2:172.21.15.189:3300/0 conn(0x7fca5806ee10 msgr2=0x7fca580ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca56d9d700 1 --2- 172.21.15.155:0/718160843 >> v2:172.21.15.189:3300/0 conn(0x7fca5806ee10 0x7fca580ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca56d9d700 1 -- 172.21.15.155:0/718160843 >> v1:172.21.15.155:6789/0 conn(0x7fca58142940 legacy=0x7fca5806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca56d9d700 1 -- 172.21.15.155:0/718160843 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580ad8f0 con 0x7fca580aebe0 2024-08-17T02:30:33.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca55d9b700 1 -- 172.21.15.155:0/718160843 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736403001 0 0) 0x7fca580ad090 con 0x7fca58142940 2024-08-17T02:30:33.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca56d9d700 1 --2- 172.21.15.155:0/718160843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580b0ed0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fca58067010 tx=0x7fca50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f39b7764f927680 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca55d9b700 1 -- 172.21.15.155:0/718160843 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000e070 con 0x7fca580aebe0 2024-08-17T02:30:33.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca55d9b700 1 -- 172.21.15.155:0/718160843 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000bb60 con 0x7fca580aebe0 2024-08-17T02:30:33.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca55d9b700 1 -- 172.21.15.155:0/718160843 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50012430 con 0x7fca580aebe0 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 -- 172.21.15.155:0/718160843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 msgr2=0x7fca580b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 --2- 172.21.15.155:0/718160843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580b0ed0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fca58067010 tx=0x7fca50009780 comp rx=0 tx=0).stop 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 -- 172.21.15.155:0/718160843 shutdown_connections 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 --2- 172.21.15.155:0/718160843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580b0ed0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 --2- 172.21.15.155:0/718160843 >> v2:172.21.15.189:3300/0 conn(0x7fca5806ee10 0x7fca580ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 -- 172.21.15.155:0/718160843 >> 172.21.15.155:0/718160843 conn(0x7fca580ca2c0 msgr2=0x7fca5806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 -- 172.21.15.155:0/718160843 shutdown_connections 2024-08-17T02:30:33.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.341+0000 7fca5759e700 1 -- 172.21.15.155:0/718160843 wait complete. 2024-08-17T02:30:33.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 Processor -- start 2024-08-17T02:30:33.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- start start 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 0x7fca580aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 0x7fca580a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58135900 con 0x7fca580aebe0 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca581329d0 con 0x7fca5806ee10 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c5560 con 0x7fca58142940 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41138/0 (socket says 172.21.15.155:41138) 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 -- 172.21.15.155:0/778299129 learned_addr learned my addr 172.21.15.155:0/778299129 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5659c700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 0x7fca580aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca56d9d700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 0x7fca580a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 -- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 msgr2=0x7fca580a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 0x7fca580a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 -- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 msgr2=0x7fca580aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 0x7fca580aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 -- 172.21.15.155:0/778299129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50009a20 con 0x7fca580aebe0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5659c700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 0x7fca580aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca56d9d700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 0x7fca580a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4dd9b700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e950 tx=0x7fca480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800c7f0 con 0x7fca580aebe0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800c950 con 0x7fca580aebe0 2024-08-17T02:30:33.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca580c5840 con 0x7fca580aebe0 2024-08-17T02:30:33.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800cd50 con 0x7fca580aebe0 2024-08-17T02:30:33.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.345+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58132f00 con 0x7fca580aebe0 2024-08-17T02:30:33.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.349+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58133120 con 0x7fca580aebe0 2024-08-17T02:30:33.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.349+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fca48013680 con 0x7fca580aebe0 2024-08-17T02:30:33.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.349+0000 7fca4effd700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 0x7fca3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.349+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fca4807ce90 con 0x7fca580aebe0 2024-08-17T02:30:33.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.349+0000 7fca5659c700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 0x7fca3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.353+0000 7fca5659c700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 0x7fca3c062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca400011e0 tx=0x7fca40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.357+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca4804d260 con 0x7fca580aebe0 2024-08-17T02:30:33.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.521+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.data", "var": "pg_num"} v 0) v1 -- 0x7fca580638f0 con 0x7fca580aebe0 2024-08-17T02:30:33.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca4effd700 1 -- 172.21.15.155:0/778299129 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000005383.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7fca48050880 con 0x7fca580aebe0 2024-08-17T02:30:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 msgr2=0x7fca3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 0x7fca3c062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca400011e0 tx=0x7fca40009040 comp rx=0 tx=0).stop 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 msgr2=0x7fca580a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e950 tx=0x7fca480091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 shutdown_connections 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fca3c060860 0x7fca3c062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fca58142940 0x7fca580a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca580aebe0 0x7fca580a5450 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 --2- 172.21.15.155:0/778299129 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca5806ee10 0x7fca580aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 >> 172.21.15.155:0/778299129 conn(0x7fca580ca2c0 msgr2=0x7fca5815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 shutdown_connections 2024-08-17T02:30:33.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.525+0000 7fca5759e700 1 -- 172.21.15.155:0/778299129 wait complete. 2024-08-17T02:30:33.540 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:33.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.641+0000 7fbb85423700 1 Processor -- start 2024-08-17T02:30:33.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.641+0000 7fbb85423700 1 -- start start 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb800ab540 0x7fbb8006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb80155720 0x7fbb800b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800aba70 con 0x7fbb8006e9d0 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800abd50 con 0x7fbb800ab540 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ac030 con 0x7fbb80155720 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb800ab540 0x7fbb8006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb800ab540 0x7fbb8006eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39088/0 (socket says 172.21.15.155:39088) 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 -- 172.21.15.155:0/2157803852 learned_addr learned my addr 172.21.15.155:0/2157803852 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb84c22700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb80155720 0x7fbb800b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 -- 172.21.15.155:0/2157803852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb80155720 msgr2=0x7fbb800b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb80155720 0x7fbb800b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 -- 172.21.15.155:0/2157803852 >> v1:172.21.15.189:6789/0 conn(0x7fbb8006e9d0 legacy=0x7fbb80155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 -- 172.21.15.155:0/2157803852 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800ac310 con 0x7fbb800ab540 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7f7fe700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800ab540 0x7fbb8006eda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800bc50 tx=0x7fbb6800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12051543cf98966 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7effd700 1 -- 172.21.15.155:0/2157803852 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800be60 con 0x7fbb800ab540 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7effd700 1 -- 172.21.15.155:0/2157803852 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6800ddc0 con 0x7fbb800ab540 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb7effd700 1 -- 172.21.15.155:0/2157803852 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680106a0 con 0x7fbb800ab540 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- 172.21.15.155:0/2157803852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800ab540 msgr2=0x7fbb8006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800ab540 0x7fbb8006eda0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800bc50 tx=0x7fbb6800b4f0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- 172.21.15.155:0/2157803852 shutdown_connections 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb80155720 0x7fbb800b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 --2- 172.21.15.155:0/2157803852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800ab540 0x7fbb8006eda0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- 172.21.15.155:0/2157803852 >> 172.21.15.155:0/2157803852 conn(0x7fbb800678d0 msgr2=0x7fbb80067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- 172.21.15.155:0/2157803852 shutdown_connections 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 -- 172.21.15.155:0/2157803852 wait complete. 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.645+0000 7fbb85423700 1 Processor -- start 2024-08-17T02:30:33.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- start start 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb8006e9d0 0x7fbb80169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb800ab540 0x7fbb8014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015e900 con 0x7fbb80155720 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8016a150 con 0x7fbb800ab540 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015c820 con 0x7fbb8006e9d0 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39098/0 (socket says 172.21.15.155:39098) 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 -- 172.21.15.155:0/672018822 learned_addr learned my addr 172.21.15.155:0/672018822 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb7f7fe700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb800ab540 0x7fbb8014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb7ffff700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb8006e9d0 0x7fbb80169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 -- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb8006e9d0 msgr2=0x7fbb80169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb8006e9d0 0x7fbb80169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 -- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb800ab540 msgr2=0x7fbb8014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb800ab540 0x7fbb8014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 -- 172.21.15.155:0/672018822 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6800b790 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb84c22700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb78007f20 tx=0x7fbb78009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800eb90 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7800ed10 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8015bef0 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78014670 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8015c4b0 con 0x7fbb80155720 2024-08-17T02:30:33.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.649+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800643a0 con 0x7fbb80155720 2024-08-17T02:30:33.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.653+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbb780149e0 con 0x7fbb80155720 2024-08-17T02:30:33.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.653+0000 7fbb77fff700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 0x7fbb64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.653+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbb7807d1e0 con 0x7fbb80155720 2024-08-17T02:30:33.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.653+0000 7fbb7ffff700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 0x7fbb64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.653+0000 7fbb7ffff700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 0x7fbb64062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb70003a30 tx=0x7fbb70007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.657+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbb7804d5b0 con 0x7fbb80155720 2024-08-17T02:30:33.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.857+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb8015c960 con 0x7fbb80155720 2024-08-17T02:30:33.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.857+0000 7fbb77fff700 1 -- 172.21.15.155:0/672018822 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4621 (secure 0 0 0) 0x7fbb78050bd0 con 0x7fbb80155720 2024-08-17T02:30:33.859 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:33.859 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/477170548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":477170548},{"type":"v1","addr":"172.21.15.155:6837","nonce":477170548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 msgr2=0x7fbb64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 0x7fbb64062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb70003a30 tx=0x7fbb70007ea0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 msgr2=0x7fbb8015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb78007f20 tx=0x7fbb78009860 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 shutdown_connections 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbb64060860 0x7fbb64062d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb80155720 0x7fbb8015df90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb800ab540 0x7fbb8014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 --2- 172.21.15.155:0/672018822 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbb8006e9d0 0x7fbb80169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 >> 172.21.15.155:0/672018822 conn(0x7fbb800678d0 msgr2=0x7fbb800acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 shutdown_connections 2024-08-17T02:30:33.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.861+0000 7fbb85423700 1 -- 172.21.15.155:0/672018822 wait complete. 2024-08-17T02:30:33.863 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 20 2024-08-17T02:30:33.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:33.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 Processor -- start 2024-08-17T02:30:33.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 -- start start 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd58159040 0x7fbd580cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 0x7fbd580d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580cf190 con 0x7fbd5815cea0 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5815d9f0 con 0x7fbd58159040 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5df4a700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580d09a0 con 0x7fbd580d0010 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd58159040 0x7fbd580cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd58159040 0x7fbd580cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39110/0 (socket says 172.21.15.155:39110) 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 -- 172.21.15.155:0/2645476821 learned_addr learned my addr 172.21.15.155:0/2645476821 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd57fff700 1 --2- 172.21.15.155:0/2645476821 >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 0x7fbd580d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 -- 172.21.15.155:0/2645476821 >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 msgr2=0x7fbd580d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 --2- 172.21.15.155:0/2645476821 >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 0x7fbd580d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 -- 172.21.15.155:0/2645476821 >> v1:172.21.15.189:6789/0 conn(0x7fbd5815cea0 legacy=0x7fbd5815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd5cf48700 1 -- 172.21.15.155:0/2645476821 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580ce5e0 con 0x7fbd58159040 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.977+0000 7fbd57fff700 1 --2- 172.21.15.155:0/2645476821 >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 0x7fbd580d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5cf48700 1 --2- 172.21.15.155:0/2645476821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580cf620 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbd58067ef0 tx=0x7fbd48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02def384eb5ce9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd577fe700 1 -- 172.21.15.155:0/2645476821 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800b860 con 0x7fbd58159040 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd577fe700 1 -- 172.21.15.155:0/2645476821 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800b9c0 con 0x7fbd58159040 2024-08-17T02:30:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd577fe700 1 -- 172.21.15.155:0/2645476821 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800bd60 con 0x7fbd58159040 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- 172.21.15.155:0/2645476821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 msgr2=0x7fbd580cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/2645476821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580cf620 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbd58067ef0 tx=0x7fbd48009250 comp rx=0 tx=0).stop 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- 172.21.15.155:0/2645476821 shutdown_connections 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/2645476821 >> v2:172.21.15.189:3300/0 conn(0x7fbd580d0010 0x7fbd580d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/2645476821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580cf620 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- 172.21.15.155:0/2645476821 >> 172.21.15.155:0/2645476821 conn(0x7fbd58068250 msgr2=0x7fbd58068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- 172.21.15.155:0/2645476821 shutdown_connections 2024-08-17T02:30:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- 172.21.15.155:0/2645476821 wait complete. 2024-08-17T02:30:33.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 Processor -- start 2024-08-17T02:30:33.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 -- start start 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd580d0010 0x7fbd58159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.981+0000 7fbd5df4a700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd5815cea0 0x7fbd581496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580b1960 con 0x7fbd58159040 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815a420 con 0x7fbd580d0010 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815a700 con 0x7fbd5815cea0 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39118/0 (socket says 172.21.15.155:39118) 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 -- 172.21.15.155:0/766903806 learned_addr learned my addr 172.21.15.155:0/766903806 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5cf48700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd580d0010 0x7fbd58159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5d749700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd5815cea0 0x7fbd581496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 -- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd5815cea0 msgr2=0x7fbd581496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd5815cea0 0x7fbd581496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 -- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd580d0010 msgr2=0x7fbd58159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd580d0010 0x7fbd58159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 -- 172.21.15.155:0/766903806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480094f0 con 0x7fbd58159040 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd57fff700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d860 tx=0x7fbd4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0125f0 con 0x7fbd58159040 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c012750 con 0x7fbd58159040 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c012af0 con 0x7fbd58159040 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5815a9e0 con 0x7fbd58159040 2024-08-17T02:30:33.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd58149c00 con 0x7fbd58159040 2024-08-17T02:30:33.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.985+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5815b6f0 con 0x7fbd58159040 2024-08-17T02:30:33.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.989+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbd4c013480 con 0x7fbd58159040 2024-08-17T02:30:33.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.989+0000 7fbd54ff9700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 0x7fbd44062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.989+0000 7fbd5cf48700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 0x7fbd44062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.989+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbd4c07cda0 con 0x7fbd58159040 2024-08-17T02:30:33.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.989+0000 7fbd5cf48700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 0x7fbd44062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbd58067ef0 tx=0x7fbd48017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:33.993+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbd5815b6f0 con 0x7fbd58159040 2024-08-17T02:30:34.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.153+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd5815b6f0 con 0x7fbd58159040 2024-08-17T02:30:34.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.153+0000 7fbd54ff9700 1 -- 172.21.15.155:0/766903806 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fbd5815b6f0 con 0x7fbd58159040 2024-08-17T02:30:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:34.157 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":41,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:30:32.191352+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6837/2606343357":"2024-08-18T02:30:29.135388+0000","172.21.15.155:6836/2606343357":"2024-08-18T02:30:29.135388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 msgr2=0x7fbd44062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 0x7fbd44062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbd58067ef0 tx=0x7fbd48017000 comp rx=0 tx=0).stop 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 msgr2=0x7fbd580b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d860 tx=0x7fbd4c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 shutdown_connections 2024-08-17T02:30:34.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fbd44060860 0x7fbd44062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbd5815cea0 0x7fbd581496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd58159040 0x7fbd580b1420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 --2- 172.21.15.155:0/766903806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd580d0010 0x7fbd58159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 >> 172.21.15.155:0/766903806 conn(0x7fbd58068250 msgr2=0x7fbd580af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 shutdown_connections 2024-08-17T02:30:34.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.157+0000 7fbd5df4a700 1 -- 172.21.15.155:0/766903806 wait complete. 2024-08-17T02:30:34.172 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000005383 and related pools 2024-08-17T02:30:34.172 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:34.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 Processor -- start 2024-08-17T02:30:34.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 -- start start 2024-08-17T02:30:34.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd534154900 0x7fd5340b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5340cb560 0x7fd534160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340b1730 con 0x7fd5340b12d0 2024-08-17T02:30:34.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd534068790 con 0x7fd534154900 2024-08-17T02:30:34.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd53883e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341583f0 con 0x7fd5340cb560 2024-08-17T02:30:34.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd532d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd534154900 0x7fd5340b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.277+0000 7fd532d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd534154900 0x7fd5340b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39132/0 (socket says 172.21.15.155:39132) 2024-08-17T02:30:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 -- 172.21.15.155:0/2609736598 learned_addr learned my addr 172.21.15.155:0/2609736598 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53359e700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5340cb560 0x7fd534160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 -- 172.21.15.155:0/2609736598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5340cb560 msgr2=0x7fd534160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5340cb560 0x7fd534160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 -- 172.21.15.155:0/2609736598 >> v1:172.21.15.189:6789/0 conn(0x7fd5340b12d0 legacy=0x7fd5340cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 -- 172.21.15.155:0/2609736598 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340cbaa0 con 0x7fd534154900 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd532d9d700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd534154900 0x7fd5340b0d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099b0 tx=0x7fd524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461346741ea10802 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd531d9b700 1 -- 172.21.15.155:0/2609736598 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524009ea0 con 0x7fd534154900 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd531d9b700 1 -- 172.21.15.155:0/2609736598 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400b860 con 0x7fd534154900 2024-08-17T02:30:34.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd531d9b700 1 -- 172.21.15.155:0/2609736598 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400bc00 con 0x7fd534154900 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- 172.21.15.155:0/2609736598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd534154900 msgr2=0x7fd5340b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd534154900 0x7fd5340b0d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099b0 tx=0x7fd524009250 comp rx=0 tx=0).stop 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- 172.21.15.155:0/2609736598 shutdown_connections 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd5340cb560 0x7fd534160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 --2- 172.21.15.155:0/2609736598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd534154900 0x7fd5340b0d90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- 172.21.15.155:0/2609736598 >> 172.21.15.155:0/2609736598 conn(0x7fd5340678d0 msgr2=0x7fd534067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- 172.21.15.155:0/2609736598 shutdown_connections 2024-08-17T02:30:34.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- 172.21.15.155:0/2609736598 wait complete. 2024-08-17T02:30:34.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 Processor -- start 2024-08-17T02:30:34.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.281+0000 7fd53883e700 1 -- start start 2024-08-17T02:30:34.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 0x7fd534155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd534154900 0x7fd5341425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341454b0 con 0x7fd5340cb560 2024-08-17T02:30:34.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341448a0 con 0x7fd5340b12d0 2024-08-17T02:30:34.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd534144b80 con 0x7fd534154900 2024-08-17T02:30:34.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39146/0 (socket says 172.21.15.155:39146) 2024-08-17T02:30:34.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 -- 172.21.15.155:0/3001077037 learned_addr learned my addr 172.21.15.155:0/3001077037 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd532d9d700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 0x7fd534155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53359e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd534154900 0x7fd5341425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 -- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd534154900 msgr2=0x7fd5341425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd534154900 0x7fd5341425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 -- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 msgr2=0x7fd534155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 0x7fd534155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 -- 172.21.15.155:0/3001077037 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240094f0 con 0x7fd5340cb560 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd532d9d700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 0x7fd534155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53259c700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c7c0 tx=0x7fd51c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011590 con 0x7fd5340cb560 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0116f0 con 0x7fd5340cb560 2024-08-17T02:30:34.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd534144e60 con 0x7fd5340cb560 2024-08-17T02:30:34.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011ab0 con 0x7fd5340cb560 2024-08-17T02:30:34.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534156410 con 0x7fd5340cb560 2024-08-17T02:30:34.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.285+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534145660 con 0x7fd5340cb560 2024-08-17T02:30:34.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.289+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd51c01c460 con 0x7fd5340cb560 2024-08-17T02:30:34.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.289+0000 7fd52affd700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 0x7fd518062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.289+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd51c07c7b0 con 0x7fd5340cb560 2024-08-17T02:30:34.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.289+0000 7fd532d9d700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 0x7fd518062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.289+0000 7fd532d9d700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 0x7fd518062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099b0 tx=0x7fd524017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.293+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd534145660 con 0x7fd5340cb560 2024-08-17T02:30:34.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.493+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5340b1730 con 0x7fd5340cb560 2024-08-17T02:30:34.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.493+0000 7fd52affd700 1 -- 172.21.15.155:0/3001077037 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4621 (secure 0 0 0) 0x7fd5340b1730 con 0x7fd5340cb560 2024-08-17T02:30:34.496 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:34.497 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/477170548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":477170548},{"type":"v1","addr":"172.21.15.155:6837","nonce":477170548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:34.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 msgr2=0x7fd518062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 0x7fd518062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099b0 tx=0x7fd524017000 comp rx=0 tx=0).stop 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 msgr2=0x7fd534142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c7c0 tx=0x7fd51c007f10 comp rx=0 tx=0).stop 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 shutdown_connections 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd518060860 0x7fd518062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd534154900 0x7fd5341425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5340cb560 0x7fd534142060 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 --2- 172.21.15.155:0/3001077037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5340b12d0 0x7fd534155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 >> 172.21.15.155:0/3001077037 conn(0x7fd5340678d0 msgr2=0x7fd53406e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 shutdown_connections 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.497+0000 7fd53883e700 1 -- 172.21.15.155:0/3001077037 wait complete. 2024-08-17T02:30:34.501 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 20 2024-08-17T02:30:34.510 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.609+0000 7f1ab27ce700 1 Processor -- start 2024-08-17T02:30:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.609+0000 7f1ab27ce700 1 -- start start 2024-08-17T02:30:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1aac0b14a0 0x7f1aac0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0cbaa0 con 0x7f1aac154900 2024-08-17T02:30:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac068790 con 0x7f1aac0b14a0 2024-08-17T02:30:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac1583f0 con 0x7f1aac0cb390 2024-08-17T02:30:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1aac0b14a0 0x7f1aac0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1aac0b14a0 0x7f1aac0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39156/0 (socket says 172.21.15.155:39156) 2024-08-17T02:30:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 -- 172.21.15.155:0/3592696322 learned_addr learned my addr 172.21.15.155:0/3592696322 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab17cc700 1 --1- 172.21.15.155:0/3592696322 >> v1:172.21.15.155:6789/0 conn(0x7f1aac154900 0x7f1aac0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45236/0 (socket says 172.21.15.155:45236) 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab1fcd700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 -- 172.21.15.155:0/3592696322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 msgr2=0x7f1aac160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 -- 172.21.15.155:0/3592696322 >> v1:172.21.15.155:6789/0 conn(0x7f1aac154900 legacy=0x7f1aac0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 -- 172.21.15.155:0/3592696322 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0cb7d0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab1fcd700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab0fcb700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0cae50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0688d0 tx=0x7f1a9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce93aa2146c1b692 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1aa3fff700 1 -- 172.21.15.155:0/3592696322 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00b760 con 0x7f1aac0b14a0 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1aa3fff700 1 -- 172.21.15.155:0/3592696322 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00b8c0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1aa3fff700 1 -- 172.21.15.155:0/3592696322 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00bc60 con 0x7f1aac0b14a0 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3592696322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 msgr2=0x7f1aac0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0cae50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0688d0 tx=0x7f1a9c009250 comp rx=0 tx=0).stop 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3592696322 shutdown_connections 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3592696322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0cae50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3592696322 >> 172.21.15.155:0/3592696322 conn(0x7f1aac0678d0 msgr2=0x7f1aac067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3592696322 shutdown_connections 2024-08-17T02:30:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.613+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3592696322 wait complete. 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 Processor -- start 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- start start 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aac154900 0x7f1aac167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac167990 con 0x7f1aac0b14a0 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac168420 con 0x7f1aac154900 2024-08-17T02:30:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0a5610 con 0x7f1aac0cb390 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39162/0 (socket says 172.21.15.155:39162) 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 -- 172.21.15.155:0/3579650972 learned_addr learned my addr 172.21.15.155:0/3579650972 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab0fcb700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab1fcd700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aac154900 0x7f1aac167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 -- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 msgr2=0x7f1aac148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 -- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aac154900 msgr2=0x7f1aac167450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aac154900 0x7f1aac167450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 -- 172.21.15.155:0/3579650972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0094f0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab17cc700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c840 tx=0x7f1aa8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8007300 con 0x7f1aac0b14a0 2024-08-17T02:30:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8007480 con 0x7f1aac0b14a0 2024-08-17T02:30:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac167b80 con 0x7f1aac0b14a0 2024-08-17T02:30:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8004830 con 0x7f1aac0b14a0 2024-08-17T02:30:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.617+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac168140 con 0x7f1aac0b14a0 2024-08-17T02:30:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0643a0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1aa8004ba0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1aa17fa700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 0x7f1a90062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1aa807c190 con 0x7f1aac0b14a0 2024-08-17T02:30:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1ab0fcb700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 0x7f1a90062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.621+0000 7f1ab0fcb700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 0x7f1a90062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0688d0 tx=0x7f1a9c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.629+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1aa8050070 con 0x7f1aac0b14a0 2024-08-17T02:30:34.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.825+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aac06f5f0 con 0x7f1aac0b14a0 2024-08-17T02:30:34.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.825+0000 7f1aa17fa700 1 -- 172.21.15.155:0/3579650972 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f1aa804fc00 con 0x7f1aac0b14a0 2024-08-17T02:30:34.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:34.829 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/477170548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":477170548},{"type":"v1","addr":"172.21.15.155:6837","nonce":477170548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:22.632492+0000","modified":"2024-08-17T02:28:24.607569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.189:6835/1244813434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1244813434},{"type":"v1","addr":"172.21.15.189:6835","nonce":1244813434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000005383","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 msgr2=0x7f1a90062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 0x7f1a90062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0688d0 tx=0x7f1a9c016000 comp rx=0 tx=0).stop 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 msgr2=0x7f1aac0a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c840 tx=0x7f1aa8007f30 comp rx=0 tx=0).stop 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 shutdown_connections 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f1a90060890 0x7f1a90062d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aac154900 0x7f1aac167450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1aac0cb390 0x7f1aac148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 --2- 172.21.15.155:0/3579650972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aac0b14a0 0x7f1aac0a6b00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 >> 172.21.15.155:0/3579650972 conn(0x7f1aac0678d0 msgr2=0x7f1aac0634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 shutdown_connections 2024-08-17T02:30:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.829+0000 7f1ab27ce700 1 -- 172.21.15.155:0/3579650972 wait complete. 2024-08-17T02:30:34.833 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 20 2024-08-17T02:30:34.844 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:34.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 Processor -- start 2024-08-17T02:30:34.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 -- start start 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0d40af030 0x7fa0d40a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa0d40a9260 0x7fa0d40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40b0270 con 0x7fa0d415d540 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40af660 con 0x7fa0d40af030 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40af940 con 0x7fa0d40a9260 2024-08-17T02:30:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0d40af030 0x7fa0d40a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0d40af030 0x7fa0d40a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39166/0 (socket says 172.21.15.155:39166) 2024-08-17T02:30:34.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 -- 172.21.15.155:0/2430346619 learned_addr learned my addr 172.21.15.155:0/2430346619 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0da703700 1 --2- 172.21.15.155:0/2430346619 >> v2:172.21.15.189:3300/0 conn(0x7fa0d40a9260 0x7fa0d40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 -- 172.21.15.155:0/2430346619 >> v2:172.21.15.189:3300/0 conn(0x7fa0d40a9260 msgr2=0x7fa0d40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 --2- 172.21.15.155:0/2430346619 >> v2:172.21.15.189:3300/0 conn(0x7fa0d40a9260 0x7fa0d40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 -- 172.21.15.155:0/2430346619 >> v1:172.21.15.189:6789/0 conn(0x7fa0d415d540 legacy=0x7fa0d406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 -- 172.21.15.155:0/2430346619 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40afc20 con 0x7fa0d40af030 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d9701700 1 --2- 172.21.15.155:0/2430346619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d40a8d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa0d406ccc0 tx=0x7fa0cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8795c622d5e8a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d8f00700 1 -- 172.21.15.155:0/2430346619 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00e070 con 0x7fa0d40af030 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d8f00700 1 -- 172.21.15.155:0/2430346619 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc00ba50 con 0x7fa0d40af030 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0d8f00700 1 -- 172.21.15.155:0/2430346619 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0092e0 con 0x7fa0d40af030 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 -- 172.21.15.155:0/2430346619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 msgr2=0x7fa0d40a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.945+0000 7fa0dc166700 1 --2- 172.21.15.155:0/2430346619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d40a8d20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa0d406ccc0 tx=0x7fa0cc009840 comp rx=0 tx=0).stop 2024-08-17T02:30:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- 172.21.15.155:0/2430346619 shutdown_connections 2024-08-17T02:30:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 --2- 172.21.15.155:0/2430346619 >> v2:172.21.15.189:3300/0 conn(0x7fa0d40a9260 0x7fa0d40b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 --2- 172.21.15.155:0/2430346619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d40a8d20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- 172.21.15.155:0/2430346619 >> 172.21.15.155:0/2430346619 conn(0x7fa0d4066e00 msgr2=0x7fa0d4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- 172.21.15.155:0/2430346619 shutdown_connections 2024-08-17T02:30:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- 172.21.15.155:0/2430346619 wait complete. 2024-08-17T02:30:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 Processor -- start 2024-08-17T02:30:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- start start 2024-08-17T02:30:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0d40a9260 0x7fa0d41591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0d415d540 0x7fa0d40aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c9540 con 0x7fa0d40af030 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c8f10 con 0x7fa0d415d540 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.949+0000 7fa0dc166700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4098800 con 0x7fa0d40a9260 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39180/0 (socket says 172.21.15.155:39180) 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 -- 172.21.15.155:0/1157604155 learned_addr learned my addr 172.21.15.155:0/1157604155 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0da703700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0d415d540 0x7fa0d40aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9f02700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0d40a9260 0x7fa0d41591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 -- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0d40a9260 msgr2=0x7fa0d41591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0d40a9260 0x7fa0d41591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 -- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0d415d540 msgr2=0x7fa0d40aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0d415d540 0x7fa0d40aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 -- 172.21.15.155:0/1157604155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009ae0 con 0x7fa0d40af030 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0d9701700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa0d406f870 tx=0x7fa0cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc008d60 con 0x7fa0d40af030 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc026410 con 0x7fa0d40af030 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d4098ae0 con 0x7fa0d40af030 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc0267d0 con 0x7fa0d40af030 2024-08-17T02:30:34.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d4159720 con 0x7fa0d40af030 2024-08-17T02:30:34.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d40c96b0 con 0x7fa0d40af030 2024-08-17T02:30:34.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.953+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa0cc01c410 con 0x7fa0d40af030 2024-08-17T02:30:34.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.957+0000 7fa0c9ffb700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 0x7fa0b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.957+0000 7fa0d9f02700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 0x7fa0b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.957+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fa0cc07e850 con 0x7fa0d40af030 2024-08-17T02:30:34.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.957+0000 7fa0d9f02700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 0x7fa0b8062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000c00 tx=0x7fa0c4007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:34.961+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa0cc04ec20 con 0x7fa0d40af030 2024-08-17T02:30:35.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.125+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d40645c0 con 0x7fa0d40af030 2024-08-17T02:30:35.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.125+0000 7fa0c9ffb700 1 -- 172.21.15.155:0/1157604155 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fa0cc00be60 con 0x7fa0d40af030 2024-08-17T02:30:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:35.130 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":41,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:30:32.191352+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000005383.meta","create_time":"2024-08-17T02:28:21.542725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000005383"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000005383.data","create_time":"2024-08-17T02:28:21.639804+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000005383"}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6837/2606343357":"2024-08-18T02:30:29.135388+0000","172.21.15.155:6836/2606343357":"2024-08-18T02:30:29.135388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:35.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 msgr2=0x7fa0b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 0x7fa0b8062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000c00 tx=0x7fa0c4007ea0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 msgr2=0x7fa0d4097d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa0d406f870 tx=0x7fa0cc018000 comp rx=0 tx=0).stop 2024-08-17T02:30:35.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 shutdown_connections 2024-08-17T02:30:35.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa0b8060860 0x7fa0b8062d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0d415d540 0x7fa0d40aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d40af030 0x7fa0d4097d30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 --2- 172.21.15.155:0/1157604155 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa0d40a9260 0x7fa0d41591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 >> 172.21.15.155:0/1157604155 conn(0x7fa0d4066e00 msgr2=0x7fa0d415c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 shutdown_connections 2024-08-17T02:30:35.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.129+0000 7fa0dc166700 1 -- 172.21.15.155:0/1157604155 wait complete. 2024-08-17T02:30:35.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000005383 2024-08-17T02:30:35.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 Processor -- start 2024-08-17T02:30:35.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 -- start start 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 0x7f9aa0161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00cbaa0 con 0x7f9aa00b14a0 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa0157630 con 0x7f9aa0154900 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa63af700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0068790 con 0x7f9aa00cb560 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa4bac700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9aa00b14a0 0x7f9aa00cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45246/0 (socket says 172.21.15.155:45246) 2024-08-17T02:30:35.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.245+0000 7f9aa4bac700 1 -- 172.21.15.155:0/1869445743 learned_addr learned my addr 172.21.15.155:0/1869445743 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa5bae700 1 --2- 172.21.15.155:0/1869445743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 0x7f9aa0161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500700781 0 0) 0x7f9aa00cbaa0 con 0x7f9aa00b14a0 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a8c003570 con 0x7f9aa00b14a0 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa5bae700 1 -- 172.21.15.155:0/1869445743 >> v1:172.21.15.189:6789/0 conn(0x7f9aa0154900 legacy=0x7f9aa00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325074137 0 0) 0x7f9aa0157630 con 0x7f9aa0154900 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa5bae700 1 -- 172.21.15.155:0/1869445743 >> v1:172.21.15.155:6789/0 conn(0x7f9aa00b14a0 legacy=0x7f9aa00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa5bae700 1 -- 172.21.15.155:0/1869445743 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0157910 con 0x7f9aa00cb560 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa5bae700 1 --2- 172.21.15.155:0/1869445743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 0x7f9aa0161ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009910 tx=0x7f9a940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b1232cea3489e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400b680 con 0x7f9aa00cb560 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9400b7e0 con 0x7f9aa00cb560 2024-08-17T02:30:35.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9a93fff700 1 -- 172.21.15.155:0/1869445743 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400bb60 con 0x7f9aa00cb560 2024-08-17T02:30:35.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 -- 172.21.15.155:0/1869445743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 msgr2=0x7f9aa0161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 --2- 172.21.15.155:0/1869445743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 0x7f9aa0161ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009910 tx=0x7f9a940091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 -- 172.21.15.155:0/1869445743 shutdown_connections 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 --2- 172.21.15.155:0/1869445743 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00cb560 0x7f9aa0161ad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 -- 172.21.15.155:0/1869445743 >> 172.21.15.155:0/1869445743 conn(0x7f9aa00678d0 msgr2=0x7f9aa0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 -- 172.21.15.155:0/1869445743 shutdown_connections 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 -- 172.21.15.155:0/1869445743 wait complete. 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.249+0000 7f9aa63af700 1 Processor -- start 2024-08-17T02:30:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- start start 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00b14a0 0x7f9aa014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa00cb560 0x7f9aa00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00af0c0 con 0x7f9aa0154900 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00af2d0 con 0x7f9aa00cb560 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00af5b0 con 0x7f9aa00b14a0 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39196/0 (socket says 172.21.15.155:39196) 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 -- 172.21.15.155:0/927748054 learned_addr learned my addr 172.21.15.155:0/927748054 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa4bac700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa00cb560 0x7f9aa00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa53ad700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00b14a0 0x7f9aa014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 -- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00b14a0 msgr2=0x7f9aa014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00b14a0 0x7f9aa014fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 -- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa00cb560 msgr2=0x7f9aa00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa00cb560 0x7f9aa00aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 -- 172.21.15.155:0/927748054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009420 con 0x7f9aa0154900 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa5bae700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009860 tx=0x7f9a94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400bb60 con 0x7f9aa0154900 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94011420 con 0x7f9aa0154900 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa00af890 con 0x7f9aa0154900 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940117e0 con 0x7f9aa0154900 2024-08-17T02:30:35.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.253+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00afe50 con 0x7f9aa0154900 2024-08-17T02:30:35.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa00643a0 con 0x7f9aa0154900 2024-08-17T02:30:35.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9a94011b50 con 0x7f9aa0154900 2024-08-17T02:30:35.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9a917fa700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f9a9407e740 con 0x7f9aa0154900 2024-08-17T02:30:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9aa53ad700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.257+0000 7f9aa53ad700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 0x7f9a84062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a98003a40 tx=0x7f9a98007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.265+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9a9404eb10 con 0x7f9aa0154900 2024-08-17T02:30:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.457+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000005383"} v 0) v1 -- 0x7f9aa00b0040 con 0x7f9aa0154900 2024-08-17T02:30:35.460 INFO:tasks.ceph.mon.a.smithi155.stderr:2024-08-17T02:30:35.457+0000 7fac07105700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:35.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.461+0000 7f9a917fa700 1 -- 172.21.15.155:0/927748054 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000005383"}]=0 volume_0000000000005383 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 195+0+0 (secure 0 0 0) 0x7f9a94052130 con 0x7f9aa0154900 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 msgr2=0x7f9a84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 0x7f9a84062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a98003a40 tx=0x7f9a98007ec0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 msgr2=0x7f9aa006a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009860 tx=0x7f9a94017000 comp rx=0 tx=0).stop 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 shutdown_connections 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9a84060860 0x7f9a84062d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9aa0154900 0x7f9aa006a980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa00cb560 0x7f9aa00aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 --2- 172.21.15.155:0/927748054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9aa00b14a0 0x7f9aa014fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 >> 172.21.15.155:0/927748054 conn(0x7f9aa00678d0 msgr2=0x7f9aa0153570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 shutdown_connections 2024-08-17T02:30:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.465+0000 7f9aa63af700 1 -- 172.21.15.155:0/927748054 wait complete. 2024-08-17T02:30:35.469 INFO:teuthology.orchestra.run.smithi155.stderr:volume_0000000000005383 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:35.476 INFO:tasks.ceph.mds.b.smithi189.stderr: -3078> 2024-08-17T02:28:28.281+0000 7f63826ce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:35.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000005383 --yes-i-really-mean-it 2024-08-17T02:30:35.502 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-08-17T02:30:35.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 Processor -- start 2024-08-17T02:30:35.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 -- start start 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcac068840 0x7fdcac068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdcac0ca040 0x7fdcac0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0ca500 con 0x7fdcac15abc0 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac158940 con 0x7fdcac068840 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb16a2700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0ca7e0 con 0x7fdcac0ca040 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcac068840 0x7fdcac068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcac068840 0x7fdcac068c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39206/0 (socket says 172.21.15.155:39206) 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 -- 172.21.15.155:0/2288081319 learned_addr learned my addr 172.21.15.155:0/2288081319 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcb0ea1700 1 --1- 172.21.15.155:0/2288081319 >> v1:172.21.15.155:6789/0 conn(0x7fdcac15abc0 0x7fdcac15b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45262/0 (socket says 172.21.15.155:45262) 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcab7fe700 1 --2- 172.21.15.155:0/2288081319 >> v2:172.21.15.189:3300/0 conn(0x7fdcac0ca040 0x7fdcac0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 -- 172.21.15.155:0/2288081319 >> v2:172.21.15.189:3300/0 conn(0x7fdcac0ca040 msgr2=0x7fdcac0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 --2- 172.21.15.155:0/2288081319 >> v2:172.21.15.189:3300/0 conn(0x7fdcac0ca040 0x7fdcac0cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 -- 172.21.15.155:0/2288081319 >> v1:172.21.15.155:6789/0 conn(0x7fdcac15abc0 legacy=0x7fdcac15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 -- 172.21.15.155:0/2288081319 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0caac0 con 0x7fdcac068840 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcabfff700 1 --2- 172.21.15.155:0/2288081319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac068840 0x7fdcac068c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b2690 tx=0x7fdc9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1963a9fd5a2efc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcaaffd700 1 -- 172.21.15.155:0/2288081319 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c009e70 con 0x7fdcac068840 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcaaffd700 1 -- 172.21.15.155:0/2288081319 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00b860 con 0x7fdcac068840 2024-08-17T02:30:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.593+0000 7fdcaaffd700 1 -- 172.21.15.155:0/2288081319 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bc00 con 0x7fdcac068840 2024-08-17T02:30:35.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- 172.21.15.155:0/2288081319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac068840 msgr2=0x7fdcac068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/2288081319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac068840 0x7fdcac068c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b2690 tx=0x7fdc9c009250 comp rx=0 tx=0).stop 2024-08-17T02:30:35.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- 172.21.15.155:0/2288081319 shutdown_connections 2024-08-17T02:30:35.599 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/2288081319 >> v2:172.21.15.189:3300/0 conn(0x7fdcac0ca040 0x7fdcac0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/2288081319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac068840 0x7fdcac068c10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- 172.21.15.155:0/2288081319 >> 172.21.15.155:0/2288081319 conn(0x7fdcac06d800 msgr2=0x7fdcac06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- 172.21.15.155:0/2288081319 shutdown_connections 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- 172.21.15.155:0/2288081319 wait complete. 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 Processor -- start 2024-08-17T02:30:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- start start 2024-08-17T02:30:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdcac068840 0x7fdcac155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcac0ca040 0x7fdcac153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac153c40 con 0x7fdcac15abc0 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac168960 con 0x7fdcac0ca040 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb16a2700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1546f0 con 0x7fdcac068840 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb0ea1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb0ea1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39216/0 (socket says 172.21.15.155:39216) 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcabfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdcac068840 0x7fdcac155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcac0ca040 0x7fdcac153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.597+0000 7fdcb0ea1700 1 -- 172.21.15.155:0/3592648002 learned_addr learned my addr 172.21.15.155:0/3592648002 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 -- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdcac068840 msgr2=0x7fdcac155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdcac068840 0x7fdcac155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 -- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcac0ca040 msgr2=0x7fdcac153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcac0ca040 0x7fdcac153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 -- 172.21.15.155:0/3592648002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0094f0 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb0ea1700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cc70 tx=0x7fdca4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4005df0 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400a5b0 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac153e50 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400a930 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac154410 con 0x7fdcac15abc0 2024-08-17T02:30:35.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.601+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac06d0b0 con 0x7fdcac15abc0 2024-08-17T02:30:35.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.605+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdca400ace0 con 0x7fdcac15abc0 2024-08-17T02:30:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.605+0000 7fdc93fff700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 0x7fdc98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.605+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fdca407cc60 con 0x7fdcac15abc0 2024-08-17T02:30:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.605+0000 7fdcabfff700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 0x7fdc98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.605+0000 7fdcabfff700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 0x7fdc98062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b2690 tx=0x7fdc9c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.613+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdcac06d0b0 con 0x7fdcac15abc0 2024-08-17T02:30:35.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:35.813+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000005383", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdcac06d0b0 con 0x7fdcac15abc0 2024-08-17T02:30:36.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.473+0000 7fdc93fff700 1 -- 172.21.15.155:0/3592648002 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000005383", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdcac06d0b0 con 0x7fdcac15abc0 2024-08-17T02:30:36.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 msgr2=0x7fdc98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 0x7fdc98062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b2690 tx=0x7fdc9c017000 comp rx=0 tx=0).stop 2024-08-17T02:30:36.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 msgr2=0x7fdcac16ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cc70 tx=0x7fdca4001a70 comp rx=0 tx=0).stop 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 shutdown_connections 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fdc98060860 0x7fdc98062d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac15abc0 0x7fdcac16ae90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcac0ca040 0x7fdcac153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 --2- 172.21.15.155:0/3592648002 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdcac068840 0x7fdcac155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 >> 172.21.15.155:0/3592648002 conn(0x7fdcac06d800 msgr2=0x7fdcac06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 shutdown_connections 2024-08-17T02:30:36.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.481+0000 7fdcb16a2700 1 -- 172.21.15.155:0/3592648002 wait complete. 2024-08-17T02:30:36.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000005383.meta cephfs.volume_0000000000005383.meta --yes-i-really-really-mean-it 2024-08-17T02:30:36.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 Processor -- start 2024-08-17T02:30:36.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 -- start start 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2c700b26d0 0x7f2c700b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 0x7f2c700ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700c5b40 con 0x7f2c700c5fd0 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c700b2aa0 con 0x7f2c700b26d0 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7720d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70159820 con 0x7f2c700cded0 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c7620b700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2c700b26d0 0x7f2c700b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c75a0a700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2c700c5fd0 0x7f2c700c6450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:59182/0 (socket says 172.21.15.155:59182) 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c75a0a700 1 -- 172.21.15.155:0/3288935090 learned_addr learned my addr 172.21.15.155:0/3288935090 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:36.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.621+0000 7f2c76a0c700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 0x7f2c700ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c75209700 1 -- 172.21.15.155:0/3288935090 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300814369 0 0) 0x7f2c700c5b40 con 0x7f2c700c5fd0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c75209700 1 -- 172.21.15.155:0/3288935090 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c5c003570 con 0x7f2c700c5fd0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7620b700 1 -- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 msgr2=0x7f2c700ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7620b700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 0x7f2c700ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7620b700 1 -- 172.21.15.155:0/3288935090 >> v1:172.21.15.189:6789/0 conn(0x7f2c700c5fd0 legacy=0x7f2c700c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7620b700 1 -- 172.21.15.155:0/3288935090 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700c4f30 con 0x7f2c700b26d0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c76a0c700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 0x7f2c700ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7620b700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700b26d0 0x7f2c700b2e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009910 tx=0x7f2c600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80abd649a055dd46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c75209700 1 -- 172.21.15.155:0/3288935090 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011630 con 0x7f2c700b26d0 2024-08-17T02:30:36.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c75209700 1 -- 172.21.15.155:0/3288935090 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60011790 con 0x7f2c700b26d0 2024-08-17T02:30:36.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c75209700 1 -- 172.21.15.155:0/3288935090 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011b30 con 0x7f2c700b26d0 2024-08-17T02:30:36.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 -- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700b26d0 msgr2=0x7f2c700b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700b26d0 0x7f2c700b2e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009910 tx=0x7f2c600091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 -- 172.21.15.155:0/3288935090 shutdown_connections 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700cded0 0x7f2c700ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 --2- 172.21.15.155:0/3288935090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700b26d0 0x7f2c700b2e90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 -- 172.21.15.155:0/3288935090 >> 172.21.15.155:0/3288935090 conn(0x7f2c70067590 msgr2=0x7f2c700d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 -- 172.21.15.155:0/3288935090 shutdown_connections 2024-08-17T02:30:36.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.625+0000 7f2c7720d700 1 -- 172.21.15.155:0/3288935090 wait complete. 2024-08-17T02:30:36.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 Processor -- start 2024-08-17T02:30:36.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- start start 2024-08-17T02:30:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700b26d0 0x7f2c700ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700cded0 0x7f2c700c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700cd650 con 0x7f2c700c5fd0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700cce40 con 0x7f2c700cded0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700c8b50 con 0x7f2c700b26d0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39218/0 (socket says 172.21.15.155:39218) 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 -- 172.21.15.155:0/51369475 learned_addr learned my addr 172.21.15.155:0/51369475 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7620b700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700b26d0 0x7f2c700ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c76a0c700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700cded0 0x7f2c700c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 -- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700b26d0 msgr2=0x7f2c700ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700b26d0 0x7f2c700ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 -- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700cded0 msgr2=0x7f2c700c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700cded0 0x7f2c700c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 -- 172.21.15.155:0/51369475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009a20 con 0x7f2c700c5fd0 2024-08-17T02:30:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c75a0a700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c790 tx=0x7f2c6c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c005b80 con 0x7f2c700c5fd0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c005ce0 con 0x7f2c700c5fd0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c60009420 con 0x7f2c700c5fd0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0072e0 con 0x7f2c700c5fd0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.629+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c700cd370 con 0x7f2c700c5fd0 2024-08-17T02:30:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c700c8d00 con 0x7f2c700c5fd0 2024-08-17T02:30:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2c6c007650 con 0x7f2c700c5fd0 2024-08-17T02:30:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c667fc700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 0x7f2c54062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f2c6c07bfc0 con 0x7f2c700c5fd0 2024-08-17T02:30:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c7620b700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 0x7f2c54062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.633+0000 7f2c7620b700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 0x7f2c54062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c600091e0 tx=0x7f2c60017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.641+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2c6c04a480 con 0x7f2c700c5fd0 2024-08-17T02:30:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:36.809+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000005383.meta", "pool2": "cephfs.volume_0000000000005383.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2c700644b0 con 0x7f2c700c5fd0 2024-08-17T02:30:37.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.481+0000 7f2c667fc700 1 -- 172.21.15.155:0/51369475 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000005383.meta", "pool2": "cephfs.volume_0000000000005383.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000005383.meta' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f2c6c017020 con 0x7f2c700c5fd0 2024-08-17T02:30:37.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 msgr2=0x7f2c54062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 0x7f2c54062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c600091e0 tx=0x7f2c60017000 comp rx=0 tx=0).stop 2024-08-17T02:30:37.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 msgr2=0x7f2c70156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c790 tx=0x7f2c6c007e00 comp rx=0 tx=0).stop 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 shutdown_connections 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2c54060860 0x7f2c54062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c700cded0 0x7f2c700c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c700c5fd0 0x7f2c70156e80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 --2- 172.21.15.155:0/51369475 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c700b26d0 0x7f2c700ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 >> 172.21.15.155:0/51369475 conn(0x7f2c70067590 msgr2=0x7f2c700d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 shutdown_connections 2024-08-17T02:30:37.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.485+0000 7f2c7720d700 1 -- 172.21.15.155:0/51369475 wait complete. 2024-08-17T02:30:37.489 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs.volume_0000000000005383.meta' removed 2024-08-17T02:30:37.504 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000005383.data cephfs.volume_0000000000005383.data --yes-i-really-really-mean-it 2024-08-17T02:30:37.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.613+0000 7faee55a1700 1 Processor -- start 2024-08-17T02:30:37.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.613+0000 7faee55a1700 1 -- start start 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faee006d7a0 0x7faee00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee006e8b0 con 0x7faee00af350 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee006dca0 con 0x7faee00c9db0 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00a9520 con 0x7faee006d7a0 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faede7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faee006d7a0 0x7faee00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faedf7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7faee00af350 0x7faee006ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45274/0 (socket says 172.21.15.155:45274) 2024-08-17T02:30:37.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faedf7fe700 1 -- 172.21.15.155:0/1623771079 learned_addr learned my addr 172.21.15.155:0/1623771079 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:37.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faede7fc700 1 -- 172.21.15.155:0/1623771079 >> v1:172.21.15.189:6789/0 conn(0x7faee00c9db0 legacy=0x7faee00a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:37.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faede7fc700 1 -- 172.21.15.155:0/1623771079 >> v1:172.21.15.155:6789/0 conn(0x7faee00af350 legacy=0x7faee006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faede7fc700 1 -- 172.21.15.155:0/1623771079 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee006df80 con 0x7faee006d7a0 2024-08-17T02:30:37.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faede7fc700 1 --2- 172.21.15.155:0/1623771079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee006d7a0 0x7faee00aee10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faed00098e0 tx=0x7faed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8faadb6bf5ead6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faeddffb700 1 -- 172.21.15.155:0/1623771079 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0009e80 con 0x7faee006d7a0 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faeddffb700 1 -- 172.21.15.155:0/1623771079 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000b820 con 0x7faee006d7a0 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faeddffb700 1 -- 172.21.15.155:0/1623771079 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000bba0 con 0x7faee006d7a0 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- 172.21.15.155:0/1623771079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee006d7a0 msgr2=0x7faee00aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 --2- 172.21.15.155:0/1623771079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee006d7a0 0x7faee00aee10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faed00098e0 tx=0x7faed00091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- 172.21.15.155:0/1623771079 shutdown_connections 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 --2- 172.21.15.155:0/1623771079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee006d7a0 0x7faee00aee10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- 172.21.15.155:0/1623771079 >> 172.21.15.155:0/1623771079 conn(0x7faee00c93a0 msgr2=0x7faee0066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- 172.21.15.155:0/1623771079 shutdown_connections 2024-08-17T02:30:37.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- 172.21.15.155:0/1623771079 wait complete. 2024-08-17T02:30:37.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 Processor -- start 2024-08-17T02:30:37.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.617+0000 7faee55a1700 1 -- start start 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 0x7faee0171480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 0x7faee01719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00acd40 con 0x7faee00c9db0 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00aca60 con 0x7faee00af350 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee016f0f0 con 0x7faee006d7a0 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39240/0 (socket says 172.21.15.155:39240) 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 -- 172.21.15.155:0/3356874347 learned_addr learned my addr 172.21.15.155:0/3356874347 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faede7fc700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 0x7faee01719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedeffd700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 0x7faee0171480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 -- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 msgr2=0x7faee0171480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 0x7faee0171480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 -- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 msgr2=0x7faee01719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 0x7faee01719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 -- 172.21.15.155:0/3356874347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009420 con 0x7faee00c9db0 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faede7fc700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 0x7faee01719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedeffd700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 0x7faee0171480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faedf7fe700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faed800cc40 tx=0x7faed8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800a9c0 con 0x7faee00c9db0 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800ab20 con 0x7faee00c9db0 2024-08-17T02:30:37.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80070f0 con 0x7faee00c9db0 2024-08-17T02:30:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee016f3d0 con 0x7faee00c9db0 2024-08-17T02:30:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.621+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00ac040 con 0x7faee00c9db0 2024-08-17T02:30:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee016f8d0 con 0x7faee00c9db0 2024-08-17T02:30:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faed80074e0 con 0x7faee00c9db0 2024-08-17T02:30:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faec6ffd700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 0x7faecc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5448+0+0 (secure 0 0 0) 0x7faed807ceb0 con 0x7faee00c9db0 2024-08-17T02:30:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faedeffd700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 0x7faecc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.625+0000 7faedeffd700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 0x7faecc062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.633+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faed804d480 con 0x7faee00c9db0 2024-08-17T02:30:37.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:37.801+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000005383.data", "pool2": "cephfs.volume_0000000000005383.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faee00638f0 con 0x7faee00c9db0 2024-08-17T02:30:38.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.493+0000 7faec6ffd700 1 -- 172.21.15.155:0/3356874347 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000005383.data", "pool2": "cephfs.volume_0000000000005383.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000005383.data' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7faed8050aa0 con 0x7faee00c9db0 2024-08-17T02:30:38.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 msgr2=0x7faecc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 0x7faecc062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed4008040 comp rx=0 tx=0).stop 2024-08-17T02:30:38.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 msgr2=0x7faee00abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faed800cc40 tx=0x7faed8001a50 comp rx=0 tx=0).stop 2024-08-17T02:30:38.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 shutdown_connections 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7faecc060860 0x7faecc062d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee00c9db0 0x7faee00abb00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faee00af350 0x7faee01719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 --2- 172.21.15.155:0/3356874347 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7faee006d7a0 0x7faee0171480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 >> 172.21.15.155:0/3356874347 conn(0x7faee00c93a0 msgr2=0x7faee00af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 shutdown_connections 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.497+0000 7faee55a1700 1 -- 172.21.15.155:0/3356874347 wait complete. 2024-08-17T02:30:38.499 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs.volume_0000000000005383.data' removed 2024-08-17T02:30:38.510 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:30:38.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 Processor -- start 2024-08-17T02:30:38.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 -- start start 2024-08-17T02:30:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f7413fa50 0x7f9f740aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740b0810 con 0x7f9f740ad6c0 2024-08-17T02:30:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740afc70 con 0x7f9f7413f680 2024-08-17T02:30:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f7900a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f740af060 con 0x7f9f7413fa50 2024-08-17T02:30:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f737fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f7413fa50 0x7f9f740aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f78809700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9f740ad6c0 0x7f9f7406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45280/0 (socket says 172.21.15.155:45280) 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.613+0000 7f9f78809700 1 -- 172.21.15.155:0/139128550 learned_addr learned my addr 172.21.15.155:0/139128550 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f72ffd700 1 -- 172.21.15.155:0/139128550 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024849584 0 0) 0x7f9f740b0810 con 0x7f9f740ad6c0 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f72ffd700 1 -- 172.21.15.155:0/139128550 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f60003570 con 0x7f9f740ad6c0 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f737fe700 1 -- 172.21.15.155:0/139128550 >> v1:172.21.15.189:6789/0 conn(0x7f9f7413f680 legacy=0x7f9f740b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f737fe700 1 -- 172.21.15.155:0/139128550 >> v1:172.21.15.155:6789/0 conn(0x7f9f740ad6c0 legacy=0x7f9f7406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f737fe700 1 -- 172.21.15.155:0/139128550 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740af340 con 0x7f9f7413fa50 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f737fe700 1 --2- 172.21.15.155:0/139128550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413fa50 0x7f9f740aea80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f640098e0 tx=0x7f9f640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d2c69e929457b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f72ffd700 1 -- 172.21.15.155:0/139128550 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400b640 con 0x7f9f7413fa50 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f72ffd700 1 -- 172.21.15.155:0/139128550 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400b7a0 con 0x7f9f7413fa50 2024-08-17T02:30:38.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f72ffd700 1 -- 172.21.15.155:0/139128550 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400bb20 con 0x7f9f7413fa50 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 -- 172.21.15.155:0/139128550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413fa50 msgr2=0x7f9f740aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 --2- 172.21.15.155:0/139128550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413fa50 0x7f9f740aea80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f640098e0 tx=0x7f9f640091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 -- 172.21.15.155:0/139128550 shutdown_connections 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 --2- 172.21.15.155:0/139128550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413fa50 0x7f9f740aea80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 -- 172.21.15.155:0/139128550 >> 172.21.15.155:0/139128550 conn(0x7f9f740678a0 msgr2=0x7f9f74067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 -- 172.21.15.155:0/139128550 shutdown_connections 2024-08-17T02:30:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.617+0000 7f9f7900a700 1 -- 172.21.15.155:0/139128550 wait complete. 2024-08-17T02:30:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 Processor -- start 2024-08-17T02:30:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 -- start start 2024-08-17T02:30:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f740ad6c0 0x7f9f740a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f7413fa50 0x7f9f74131d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740a78a0 con 0x7f9f7413f680 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740a6fb0 con 0x7f9f7413fa50 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f7900a700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740a7250 con 0x7f9f740ad6c0 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39260/0 (socket says 172.21.15.155:39260) 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.621+0000 7f9f737fe700 1 -- 172.21.15.155:0/2348643754 learned_addr learned my addr 172.21.15.155:0/2348643754 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f78809700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f7413fa50 0x7f9f74131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f73fff700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f740ad6c0 0x7f9f740a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 -- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f740ad6c0 msgr2=0x7f9f740a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f740ad6c0 0x7f9f740a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 -- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f7413fa50 msgr2=0x7f9f74131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f7413fa50 0x7f9f74131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 -- 172.21.15.155:0/2348643754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64009420 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f737fe700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9f7406fbb0 tx=0x7f9f64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400bb20 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f64011420 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f740a7530 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640117e0 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f740a9e40 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f740a7a50 con 0x7f9f7413f680 2024-08-17T02:30:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.625+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9f64011bd0 con 0x7f9f7413f680 2024-08-17T02:30:38.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.629+0000 7f9f6bfff700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 0x7f9f54062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.629+0000 7f9f73fff700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 0x7f9f54062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.629+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9f6407e0f0 con 0x7f9f7413f680 2024-08-17T02:30:38.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.629+0000 7f9f73fff700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 0x7f9f54062d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003880 tx=0x7f9f5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.633+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9f740a7a50 con 0x7f9f7413f680 2024-08-17T02:30:38.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.800+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9f740a7a50 con 0x7f9f7413f680 2024-08-17T02:30:38.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f6bfff700 1 -- 172.21.15.155:0/2348643754 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9f740a7a50 con 0x7f9f7413f680 2024-08-17T02:30:38.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 msgr2=0x7f9f54062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 0x7f9f54062d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003880 tx=0x7f9f5c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 msgr2=0x7f9f74131810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9f7406fbb0 tx=0x7f9f64017000 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 shutdown_connections 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9f54060890 0x7f9f54062d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f7413fa50 0x7f9f74131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f7413f680 0x7f9f74131810 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 --2- 172.21.15.155:0/2348643754 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f9f740ad6c0 0x7f9f740a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 >> 172.21.15.155:0/2348643754 conn(0x7f9f740678a0 msgr2=0x7f9f7413c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 shutdown_connections 2024-08-17T02:30:38.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.808+0000 7f9f7900a700 1 -- 172.21.15.155:0/2348643754 wait complete. 2024-08-17T02:30:38.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:30:38.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 Processor -- start 2024-08-17T02:30:38.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 -- start start 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f370c0c86a0 0x7f370c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 0x7f370c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0c3e80 con 0x7f370c068b40 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0ca410 con 0x7f370c0c86a0 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3713fd6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0cdd30 con 0x7f370c0c2e00 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f370c0c86a0 0x7f370c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f370c0c86a0 0x7f370c0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39270/0 (socket says 172.21.15.155:39270) 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 -- 172.21.15.155:0/3666758133 learned_addr learned my addr 172.21.15.155:0/3666758133 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:38.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711571700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 0x7f370c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 -- 172.21.15.155:0/3666758133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 msgr2=0x7f370c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 0x7f370c068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 -- 172.21.15.155:0/3666758133 >> v1:172.21.15.189:6789/0 conn(0x7f370c068b40 legacy=0x7f370c0c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 -- 172.21.15.155:0/3666758133 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0c3270 con 0x7f370c0c86a0 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711571700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 0x7f370c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3711d72700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0c86a0 0x7f370c0cbdc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3704009f20 tx=0x7f3704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da6a078d64abb3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3710d70700 1 -- 172.21.15.155:0/3666758133 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400e070 con 0x7f370c0c86a0 2024-08-17T02:30:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3710d70700 1 -- 172.21.15.155:0/3666758133 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400ba80 con 0x7f370c0c86a0 2024-08-17T02:30:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.932+0000 7f3710d70700 1 -- 172.21.15.155:0/3666758133 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040092e0 con 0x7f370c0c86a0 2024-08-17T02:30:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- 172.21.15.155:0/3666758133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0c86a0 msgr2=0x7f370c0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0c86a0 0x7f370c0cbdc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3704009f20 tx=0x7f3704009840 comp rx=0 tx=0).stop 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- 172.21.15.155:0/3666758133 shutdown_connections 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c2e00 0x7f370c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 --2- 172.21.15.155:0/3666758133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0c86a0 0x7f370c0cbdc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- 172.21.15.155:0/3666758133 >> 172.21.15.155:0/3666758133 conn(0x7f370c0caad0 msgr2=0x7f370c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- 172.21.15.155:0/3666758133 shutdown_connections 2024-08-17T02:30:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- 172.21.15.155:0/3666758133 wait complete. 2024-08-17T02:30:38.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 Processor -- start 2024-08-17T02:30:38.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.936+0000 7f3713fd6700 1 -- start start 2024-08-17T02:30:38.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f370c0c2e00 0x7f370c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 0x7f370c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c7dd0 con 0x7f370c068b40 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c069a80 con 0x7f370c0c2e00 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c069150 con 0x7f370c0c86a0 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39282/0 (socket says 172.21.15.155:39282) 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 -- 172.21.15.155:0/1018556252 learned_addr learned my addr 172.21.15.155:0/1018556252 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711571700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f370c0c2e00 0x7f370c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3712573700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 0x7f370c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 -- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 msgr2=0x7f370c0c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 0x7f370c0c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 -- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f370c0c2e00 msgr2=0x7f370c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f370c0c2e00 0x7f370c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 -- 172.21.15.155:0/1018556252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009ae0 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3712573700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 0x7f370c0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3711d72700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f370400bf20 tx=0x7f3704018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704008980 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704008ae0 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c069430 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704008ea0 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c069f10 con 0x7f370c068b40 2024-08-17T02:30:38.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.940+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c0645c0 con 0x7f370c068b40 2024-08-17T02:30:38.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.944+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3704003040 con 0x7f370c068b40 2024-08-17T02:30:38.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.944+0000 7f36fdffb700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 0x7f36f0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.944+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f370407e400 con 0x7f370c068b40 2024-08-17T02:30:38.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.944+0000 7f3711571700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 0x7f36f0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.944+0000 7f3711571700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 0x7f36f0062d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f370c0c95d0 tx=0x7f3700008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:38.948+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f370404eb70 con 0x7f370c068b40 2024-08-17T02:30:39.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.172+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f370c161fa0 con 0x7f370c068b40 2024-08-17T02:30:39.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.488+0000 7f36fdffb700 1 -- 172.21.15.155:0/1018556252 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v152) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3704052190 con 0x7f370c068b40 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 msgr2=0x7f36f0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 0x7f36f0062d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f370c0c95d0 tx=0x7f3700008040 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 msgr2=0x7f370c140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f370400bf20 tx=0x7f3704018000 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 shutdown_connections 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f36f0060890 0x7f36f0062d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f370c0c86a0 0x7f370c0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f370c0c2e00 0x7f370c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 --2- 172.21.15.155:0/1018556252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c068b40 0x7f370c140430 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 >> 172.21.15.155:0/1018556252 conn(0x7f370c0caad0 msgr2=0x7f370c0b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 shutdown_connections 2024-08-17T02:30:39.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:39.492+0000 7f3713fd6700 1 -- 172.21.15.155:0/1018556252 wait complete. 2024-08-17T02:30:39.516 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:39.517 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000005383 --yes-i-really-mean-it' 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:39.518 INFO:tasks.cephfs_test_runner:Ran 1 test in 166.805s 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:39.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000005383 --yes-i-really-mean-it' 2024-08-17T02:30:39.520 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:39.521 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:39.750 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07e09af21e634c6b9d20216fe6edc440 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:39.752 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:30:39.760 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:30:39.768 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:30:39.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:39.768 DEBUG:teuthology.orchestra.run.smithi189:> ip netns list 2024-08-17T02:30:39.782 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:30:39.782 INFO:teuthology.orchestra.run.smithi189.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:30:39.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:39.783 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:30:39.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:39.838 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:30:39.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:39.854 DEBUG:teuthology.orchestra.run.smithi189:> sudo ip link delete ceph-brx 2024-08-17T02:30:40.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:40.014 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-08-17T02:30:40.022 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:30:40.022 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:30:40.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:40.023 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:30:40.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:40.082 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:30:40.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:40.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-08-17T02:30:40.248 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:30:40.257 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:30:40.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 Processor -- start 2024-08-17T02:30:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 -- start start 2024-08-17T02:30:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0b01551b0 0x7fb0b0155580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b00aca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00aded0 con 0x7fb0b01551b0 2024-08-17T02:30:40.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00ad2c0 con 0x7fb0b01590b0 2024-08-17T02:30:40.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0b4807700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00ad5a0 con 0x7fb0b00afa50 2024-08-17T02:30:40.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0af7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0b01551b0 0x7fb0b0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0affff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0affff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:58842/0 (socket says 172.21.15.155:58842) 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0af7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0b01551b0 0x7fb0b0155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39284/0 (socket says 172.21.15.155:39284) 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0affff700 1 -- 172.21.15.155:0/94761857 learned_addr learned my addr 172.21.15.155:0/94761857 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.372+0000 7fb0aeffd700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b00aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 -- 172.21.15.155:0/94761857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 msgr2=0x7fb0b00aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:40.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b00aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 -- 172.21.15.155:0/94761857 >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 msgr2=0x7fb0b0159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/94761857 >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 -- 172.21.15.155:0/94761857 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00ad880 con 0x7fb0b01551b0 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0affff700 1 --2- 172.21.15.155:0/94761857 >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b0155580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00686e0 tx=0x7fb0a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe19b9ac9d80038 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0ae7fc700 1 -- 172.21.15.155:0/94761857 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011630 con 0x7fb0b01551b0 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0ae7fc700 1 -- 172.21.15.155:0/94761857 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00117b0 con 0x7fb0b01551b0 2024-08-17T02:30:40.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0ae7fc700 1 -- 172.21.15.155:0/94761857 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011b70 con 0x7fb0b01551b0 2024-08-17T02:30:40.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- 172.21.15.155:0/94761857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 msgr2=0x7fb0b0155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b0155580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00686e0 tx=0x7fb0a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- 172.21.15.155:0/94761857 shutdown_connections 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 --2- 172.21.15.155:0/94761857 >> v2:172.21.15.189:3300/0 conn(0x7fb0b01590b0 0x7fb0b0159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b00aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 --2- 172.21.15.155:0/94761857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b0155580 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- 172.21.15.155:0/94761857 >> 172.21.15.155:0/94761857 conn(0x7fb0b0067860 msgr2=0x7fb0b0067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- 172.21.15.155:0/94761857 shutdown_connections 2024-08-17T02:30:40.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- 172.21.15.155:0/94761857 wait complete. 2024-08-17T02:30:40.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 Processor -- start 2024-08-17T02:30:40.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.376+0000 7fb0b4807700 1 -- start start 2024-08-17T02:30:40.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b01661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 0x7fb0b00a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a65c0 con 0x7fb0b01551b0 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a68a0 con 0x7fb0b01590b0 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00a6b80 con 0x7fb0b00afa50 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39292/0 (socket says 172.21.15.155:39292) 2024-08-17T02:30:40.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 -- 172.21.15.155:0/3628896831 learned_addr learned my addr 172.21.15.155:0/3628896831 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b01661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0affff700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 0x7fb0b00a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 -- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 msgr2=0x7fb0b01661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b01661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 -- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 msgr2=0x7fb0b00a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 0x7fb0b00a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 -- 172.21.15.155:0/3628896831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80078a0 con 0x7fb0b01551b0 2024-08-17T02:30:40.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b01661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0affff700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 0x7fb0b00a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0aeffd700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400de50 tx=0x7fb0a400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400aea0 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4013040 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a0009420 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4010e50 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0166710 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00a7080 con 0x7fb0b01551b0 2024-08-17T02:30:40.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0a4018690 con 0x7fb0b01551b0 2024-08-17T02:30:40.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 0x7fb09c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb0a4081180 con 0x7fb0b01551b0 2024-08-17T02:30:40.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.380+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 0x7fb09c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.384+0000 7fb0af7fe700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 0x7fb09c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00686e0 tx=0x7fb0a0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.388+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb0a4051870 con 0x7fb0b01551b0 2024-08-17T02:30:40.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.552+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b00643a0 con 0x7fb0b01551b0 2024-08-17T02:30:40.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.552+0000 7fb0977fe700 1 -- 172.21.15.155:0/3628896831 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7fb0a4054e90 con 0x7fb0b01551b0 2024-08-17T02:30:40.557 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:40.557 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":44,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:30:38.477007+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/1244813434":"2024-08-18T02:30:35.460322+0000","172.21.15.189:6834/1244813434":"2024-08-18T02:30:35.460322+0000","172.21.15.155:6837/2606343357":"2024-08-18T02:30:29.135388+0000","172.21.15.155:6836/2606343357":"2024-08-18T02:30:29.135388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:40.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 msgr2=0x7fb09c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 0x7fb09c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00686e0 tx=0x7fb0a0017000 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 msgr2=0x7fb0b00ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400de50 tx=0x7fb0a400f040 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 shutdown_connections 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb09c060860 0x7fb09c062d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0b01590b0 0x7fb0b00a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01551b0 0x7fb0b00ab280 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 --2- 172.21.15.155:0/3628896831 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0b00afa50 0x7fb0b01661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 >> 172.21.15.155:0/3628896831 conn(0x7fb0b0067860 msgr2=0x7fb0b006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 shutdown_connections 2024-08-17T02:30:40.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.556+0000 7fb0b4807700 1 -- 172.21.15.155:0/3628896831 wait complete. 2024-08-17T02:30:40.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:30:40.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:40.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 Processor -- start 2024-08-17T02:30:40.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- start start 2024-08-17T02:30:40.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf00159040 0x7fcf000cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 0x7fcf000d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000cf190 con 0x7fcf0015cea0 2024-08-17T02:30:40.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0015d9f0 con 0x7fcf00159040 2024-08-17T02:30:40.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000d09a0 con 0x7fcf000d0010 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf00159040 0x7fcf000cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcf00159040 0x7fcf000cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39302/0 (socket says 172.21.15.155:39302) 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf04900700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcf0015cea0 0x7fcf0015d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45282/0 (socket says 172.21.15.155:45282) 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 -- 172.21.15.155:0/2375288693 learned_addr learned my addr 172.21.15.155:0/2375288693 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fceff7fe700 1 --2- 172.21.15.155:0/2375288693 >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 0x7fcf000d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 -- 172.21.15.155:0/2375288693 >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 msgr2=0x7fcf000d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 --2- 172.21.15.155:0/2375288693 >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 0x7fcf000d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 -- 172.21.15.155:0/2375288693 >> v1:172.21.15.155:6789/0 conn(0x7fcf0015cea0 legacy=0x7fcf0015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefeffd700 1 -- 172.21.15.155:0/2375288693 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308851955 0 0) 0x7fcf000cf190 con 0x7fcf0015cea0 2024-08-17T02:30:40.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 -- 172.21.15.155:0/2375288693 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000ce5e0 con 0x7fcf00159040 2024-08-17T02:30:40.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fceff7fe700 1 --2- 172.21.15.155:0/2375288693 >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 0x7fcf000d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:40.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefffff700 1 --2- 172.21.15.155:0/2375288693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf00159040 0x7fcf000cf620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf00067ef0 tx=0x7fcef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c862631a454686e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefeffd700 1 -- 172.21.15.155:0/2375288693 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000b860 con 0x7fcf00159040 2024-08-17T02:30:40.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefeffd700 1 -- 172.21.15.155:0/2375288693 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000b9c0 con 0x7fcf00159040 2024-08-17T02:30:40.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcefeffd700 1 -- 172.21.15.155:0/2375288693 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000bd60 con 0x7fcf00159040 2024-08-17T02:30:40.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- 172.21.15.155:0/2375288693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf00159040 msgr2=0x7fcf000cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 --2- 172.21.15.155:0/2375288693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf00159040 0x7fcf000cf620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf00067ef0 tx=0x7fcef0009250 comp rx=0 tx=0).stop 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- 172.21.15.155:0/2375288693 shutdown_connections 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 --2- 172.21.15.155:0/2375288693 >> v2:172.21.15.189:3300/0 conn(0x7fcf000d0010 0x7fcf000d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 --2- 172.21.15.155:0/2375288693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf00159040 0x7fcf000cf620 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- 172.21.15.155:0/2375288693 >> 172.21.15.155:0/2375288693 conn(0x7fcf00068250 msgr2=0x7fcf00068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- 172.21.15.155:0/2375288693 shutdown_connections 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.668+0000 7fcf05101700 1 -- 172.21.15.155:0/2375288693 wait complete. 2024-08-17T02:30:40.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 Processor -- start 2024-08-17T02:30:40.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 -- start start 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 0x7fcf00151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 0x7fcf0015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000ae640 con 0x7fcf000d0010 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000afed0 con 0x7fcf0015cea0 2024-08-17T02:30:40.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf05101700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b01b0 con 0x7fcf00159040 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcefffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcefffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39312/0 (socket says 172.21.15.155:39312) 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcefffff700 1 -- 172.21.15.155:0/4061422256 learned_addr learned my addr 172.21.15.155:0/4061422256 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fcf04900700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 0x7fcf0015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.672+0000 7fceff7fe700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 0x7fcf00151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 -- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 msgr2=0x7fcf00151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 0x7fcf00151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 -- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 msgr2=0x7fcf0015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 0x7fcf0015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 -- 172.21.15.155:0/4061422256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00094f0 con 0x7fcf000d0010 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcf04900700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 0x7fcf0015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fceff7fe700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 0x7fcf00151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcefffff700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcef00090b0 tx=0x7fcef0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0011e60 con 0x7fcf000d0010 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef001f070 con 0x7fcf000d0010 2024-08-17T02:30:40.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf000b0490 con 0x7fcf000d0010 2024-08-17T02:30:40.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef001a890 con 0x7fcf000d0010 2024-08-17T02:30:40.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf000a6ef0 con 0x7fcf000d0010 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000643a0 con 0x7fcf000d0010 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcef001ac00 con 0x7fcf000d0010 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fcee7fff700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.676+0000 7fceff7fe700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.680+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcef0021070 con 0x7fcf000d0010 2024-08-17T02:30:40.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.680+0000 7fceff7fe700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 0x7fceec062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcef4006f00 tx=0x7fcef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.684+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcef004ee40 con 0x7fcf000d0010 2024-08-17T02:30:40.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.844+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf000b0c20 con 0x7fceec060860 2024-08-17T02:30:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcee7fff700 1 -- 172.21.15.155:0/4061422256 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48764 (secure 0 0 0) 0x7fcf000b0c20 con 0x7fceec060860 2024-08-17T02:30:40.854 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 msgr2=0x7fceec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 0x7fceec062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcef4006f00 tx=0x7fcef4008040 comp rx=0 tx=0).stop 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 msgr2=0x7fcf000a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcef00090b0 tx=0x7fcef0017000 comp rx=0 tx=0).stop 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 shutdown_connections 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fceec060860 0x7fceec062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf0015cea0 0x7fcf0015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcf00159040 0x7fcf00151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 --2- 172.21.15.155:0/4061422256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf000d0010 0x7fcf000a69b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 >> 172.21.15.155:0/4061422256 conn(0x7fcf00068250 msgr2=0x7fcf00159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 shutdown_connections 2024-08-17T02:30:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.852+0000 7fcf05101700 1 -- 172.21.15.155:0/4061422256 wait complete. 2024-08-17T02:30:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:30:40.869 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-08-17T02:30:40.011976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396304,"kb_used_data":4956,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578416,"statfs":{"total":773094113280,"available":770640297984,"internally_reserved":0,"allocated":5074944,"data_stored":2800515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001731"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:30:31.778438+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:30:31.778438+0000","last_peered":"2024-08-17T02:30:31.778438+0000","last_clean":"2024-08-17T02:30:31.778438+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:30:31.778438+0000","last_undegraded":"2024-08-17T02:30:31.778438+0000","last_fullsized":"2024-08-17T02:30:31.778438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":206699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.177,"5min":1.306,"15min":1.306},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.84099999999999997,"15min":0.81699999999999995},"min":{"1min":0.65700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.94399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88900000000000001,"15min":0.85699999999999998},"min":{"1min":0.63800000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.446,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.74399999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.335,"5min":1.637,"15min":1.637},"last":1.246}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88900000000000001,"15min":0.86899999999999999},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.224,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.88100000000000001,"15min":0.87},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.85499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.98999999999999999,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92900000000000005,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.623}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89400000000000002,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.27,"5min":1.276,"15min":1.276},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.111}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4810000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0209999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.397,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.171,"15min":1.157},"min":{"1min":0.88200000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.417,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.373}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.88400000000000001,"15min":0.83499999999999996},"min":{"1min":0.64000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.069},{"interface":"front","average":{"1min":0.997,"5min":0.97499999999999998,"15min":0.96299999999999997},"min":{"1min":0.79000000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.206,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.135}]},{"osd":1,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.63,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88800000000000001},"min":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2090000000000001,"5min":1.349,"15min":1.349},"last":0.90200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.93899999999999995,"15min":0.95199999999999996},"min":{"1min":0.73199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1779999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.69499999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.99399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.68799999999999994,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.008,"15min":1.022},"min":{"1min":0.82699999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.355,"5min":1.536,"15min":1.536},"last":1.165}]},{"osd":4,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.417,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3380000000000001,"5min":1.448,"15min":1.448},"last":1.292}]},{"osd":5,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.125},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.359,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.256},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.71299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4890000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1439999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.385,"5min":1.536,"15min":1.536},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":1.048,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4990000000000001,"5min":2.194,"15min":2.194},"last":1.3360000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1081344,"data_stored":796044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.321,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.194,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96399999999999997,"15min":0.96199999999999997},"min":{"1min":0.77800000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.196,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97199999999999998,"15min":0.98199999999999998},"min":{"1min":0.73599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.258,"5min":2.105,"15min":2.105},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.72899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2909999999999999,"5min":2.153,"15min":2.153},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0649999999999999,"15min":1.095},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1459999999999999,"5min":1.919,"15min":1.919},"last":1.179}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.2050000000000001},"min":{"1min":0.752,"5min":0.623,"15min":0.623},"max":{"1min":1.2909999999999999,"5min":2.431,"15min":2.431},"last":1.056}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1240000000000001,"15min":1.1519999999999999},"min":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.353,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.02},{"interface":"front","average":{"1min":1.177,"5min":1.169,"15min":1.173},"min":{"1min":0.875,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5329999999999999,"5min":2.04,"15min":2.04},"last":1.262}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.194},"min":{"1min":0.84399999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.508,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.248,"15min":1.2769999999999999},"min":{"1min":0.95099999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.419,"5min":2.27,"15min":2.27},"last":1.294}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":202108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.93899999999999995,"15min":0.96299999999999997},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.141,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66300000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.69499999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.204},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.85699999999999998},"min":{"1min":0.64900000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1220000000000001,"5min":1.212,"15min":1.212},"last":1.097}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1850000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.0029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0269999999999999,"5min":1.266,"15min":1.266},"last":1.175},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2889999999999999,"5min":1.363,"15min":1.363},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2030000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.135,"15min":1.1919999999999999},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.1879999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.161,"15min":1.206},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.353,"5min":2.25,"15min":2.25},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.1839999999999999,"15min":1.1970000000000001},"min":{"1min":0.91700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2949999999999999,"5min":1.706,"15min":1.706},"last":1.135}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1830000000000001,"15min":1.238},"min":{"1min":0.80600000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.228,"5min":2.359,"15min":2.359},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5049999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":487424,"data_stored":202016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.69999999999999996},"min":{"1min":0.624,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.032}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.66100000000000003},"min":{"1min":0.502,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.113},"last":0.497}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.123,"5min":1.601,"15min":1.601},"last":0.71599999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0700000000000001,"5min":1.21,"15min":1.21},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.83799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1599999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1850000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0620000000000001,"15min":1.0609999999999999},"min":{"1min":0.90900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.24,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1160000000000001},"min":{"1min":0.92700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.272,"5min":1.768,"15min":1.768},"last":1.0589999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.415,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.149,"15min":1.137},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.476,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.95799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":200554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.502,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88200000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.093,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.629,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.95999999999999996,"5min":1.173,"15min":1.173},"last":1.0049999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.255,"15min":0.255},"max":{"1min":0.92300000000000004,"5min":1.143,"15min":1.143},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.70099999999999996,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0089999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.96599999999999997},"min":{"1min":0.90000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.534,"15min":1.534},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.018,"15min":0.99399999999999999},"min":{"1min":0.80900000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.0089999999999999},"min":{"1min":0.80300000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4079999999999999,"5min":1.476,"15min":1.476},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.0469999999999999},"min":{"1min":0.85299999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.167,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.048,"15min":1.0720000000000001},"min":{"1min":0.746,"5min":0.502,"15min":0.502},"max":{"1min":1.2709999999999999,"5min":1.823,"15min":1.823},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.91000000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3740000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.109,"15min":1.083},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.437},"max":{"1min":1.4990000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.98699999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1073152,"data_stored":790902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0880000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0649999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1140000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.022,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88100000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.016,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.3580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2609999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.81399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2350000000000001,"5min":1.26,"15min":1.26},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.095,"15min":1.1160000000000001},"min":{"1min":0.86599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4330000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.091,"15min":1.101},"min":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.25},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0980000000000001,"15min":1.109},"min":{"1min":0.89400000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.3500000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.0960000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.107,"15min":1.1220000000000001},"min":{"1min":0.86399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2809999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1799999999999999,"15min":1.204},"min":{"1min":0.80100000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6359999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0740000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.70199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56599999999999995,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.746},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84899999999999998,"15min":0.84199999999999997},"min":{"1min":0.66500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.823,"15min":1.823},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1040000000000001,"5min":1.367,"15min":1.367},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.96899999999999997},"min":{"1min":0.91800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.218}]},{"osd":5,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.86199999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3160000000000001,"5min":1.379,"15min":1.379},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.05,"15min":1.0449999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3420000000000001,"5min":1.768,"15min":1.768},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0900000000000001,"15min":1.093},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3380000000000001,"5min":1.913,"15min":1.913},"last":1.276},{"interface":"front","average":{"1min":1.129,"5min":1.0669999999999999,"15min":1.0449999999999999},"min":{"1min":0.84699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.087,"15min":1.075},"min":{"1min":0.874,"5min":0.75,"15min":0.75},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.026},{"interface":"front","average":{"1min":1.171,"5min":1.1020000000000001,"15min":1.0800000000000001},"min":{"1min":1.0029999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.944,"15min":1.944},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:40.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:40.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.968+0000 7eff0ffff700 1 Processor -- start 2024-08-17T02:30:40.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.968+0000 7eff0ffff700 1 -- start start 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.968+0000 7eff0ffff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 0x7eff100aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.968+0000 7eff0ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff100680e0 0x7eff100cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10068500 con 0x7eff100af170 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100af5f0 con 0x7eff100680e0 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100c97d0 con 0x7eff10154910 2024-08-17T02:30:40.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff100680e0 0x7eff100cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff067fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7eff100af170 0x7eff100679d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45292/0 (socket says 172.21.15.155:45292) 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff067fc700 1 -- 172.21.15.155:0/1686266652 learned_addr learned my addr 172.21.15.155:0/1686266652 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0effd700 1 --2- 172.21.15.155:0/1686266652 >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 0x7eff100aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 -- 172.21.15.155:0/1686266652 >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 msgr2=0x7eff100aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0e7fc700 1 -- 172.21.15.155:0/1686266652 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275977727 0 0) 0x7efef8001110 con 0x7eff100af170 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 --2- 172.21.15.155:0/1686266652 >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 0x7eff100aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 -- 172.21.15.155:0/1686266652 >> v1:172.21.15.155:6789/0 conn(0x7eff100af170 legacy=0x7eff100679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 -- 172.21.15.155:0/1686266652 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100ca7e0 con 0x7eff100680e0 2024-08-17T02:30:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0effd700 1 --2- 172.21.15.155:0/1686266652 >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 0x7eff100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0f7fe700 1 --2- 172.21.15.155:0/1686266652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100680e0 0x7eff100cac50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff100afb80 tx=0x7eff08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122087a5e2d17c3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0e7fc700 1 -- 172.21.15.155:0/1686266652 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800e070 con 0x7eff100680e0 2024-08-17T02:30:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0e7fc700 1 -- 172.21.15.155:0/1686266652 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800bc30 con 0x7eff100680e0 2024-08-17T02:30:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0e7fc700 1 -- 172.21.15.155:0/1686266652 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08012430 con 0x7eff100680e0 2024-08-17T02:30:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- 172.21.15.155:0/1686266652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100680e0 msgr2=0x7eff100cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 --2- 172.21.15.155:0/1686266652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100680e0 0x7eff100cac50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff100afb80 tx=0x7eff08009780 comp rx=0 tx=0).stop 2024-08-17T02:30:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- 172.21.15.155:0/1686266652 shutdown_connections 2024-08-17T02:30:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 --2- 172.21.15.155:0/1686266652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100680e0 0x7eff100cac50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 --2- 172.21.15.155:0/1686266652 >> v2:172.21.15.189:3300/0 conn(0x7eff10154910 0x7eff100aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- 172.21.15.155:0/1686266652 >> 172.21.15.155:0/1686266652 conn(0x7eff100cd860 msgr2=0x7eff100b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- 172.21.15.155:0/1686266652 shutdown_connections 2024-08-17T02:30:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.972+0000 7eff0ffff700 1 -- 172.21.15.155:0/1686266652 wait complete. 2024-08-17T02:30:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 Processor -- start 2024-08-17T02:30:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 -- start start 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff100680e0 0x7eff101509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 0x7eff10158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015a1b0 con 0x7eff100af170 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100a5da0 con 0x7eff100680e0 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff0ffff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff10159220 con 0x7eff10154910 2024-08-17T02:30:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff067fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff067fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39330/0 (socket says 172.21.15.155:39330) 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.976+0000 7eff067fc700 1 -- 172.21.15.155:0/719722165 learned_addr learned my addr 172.21.15.155:0/719722165 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0f7fe700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 0x7eff10158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0effd700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff100680e0 0x7eff101509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 -- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 msgr2=0x7eff10158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 0x7eff10158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 -- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff100680e0 msgr2=0x7eff101509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff100680e0 0x7eff101509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 -- 172.21.15.155:0/719722165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009a20 con 0x7eff100af170 2024-08-17T02:30:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0f7fe700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 0x7eff10158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff067fc700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efef800c810 tx=0x7efef8007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8005b30 con 0x7eff100af170 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8005c90 con 0x7eff100af170 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10159500 con 0x7eff100af170 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8007300 con 0x7eff100af170 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff10159e40 con 0x7eff100af170 2024-08-17T02:30:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efef801b400 con 0x7eff100af170 2024-08-17T02:30:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.980+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1015a320 con 0x7eff100af170 2024-08-17T02:30:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.984+0000 7eff077fe700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 0x7efef0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.984+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efef807c390 con 0x7eff100af170 2024-08-17T02:30:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.984+0000 7eff0effd700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 0x7efef0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.984+0000 7eff0effd700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 0x7efef0062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff00006fd0 tx=0x7eff00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:40.992+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efef8050510 con 0x7eff100af170 2024-08-17T02:30:41.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.152+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff10068500 con 0x7efef0060860 2024-08-17T02:30:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.152+0000 7eff077fe700 1 -- 172.21.15.155:0/719722165 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48764 (secure 0 0 0) 0x7eff10068500 con 0x7efef0060860 2024-08-17T02:30:41.158 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 msgr2=0x7efef0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 0x7efef0062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff00006fd0 tx=0x7eff00008040 comp rx=0 tx=0).stop 2024-08-17T02:30:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 msgr2=0x7eff101586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efef800c810 tx=0x7efef8007c50 comp rx=0 tx=0).stop 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 shutdown_connections 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efef0060860 0x7efef0062d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7eff10154910 0x7eff10158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff100af170 0x7eff101586b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 --2- 172.21.15.155:0/719722165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff100680e0 0x7eff101509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 >> 172.21.15.155:0/719722165 conn(0x7eff100cd860 msgr2=0x7eff10151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 shutdown_connections 2024-08-17T02:30:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.156+0000 7eff0ffff700 1 -- 172.21.15.155:0/719722165 wait complete. 2024-08-17T02:30:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:30:41.171 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-08-17T02:30:40.011976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396304,"kb_used_data":4956,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578416,"statfs":{"total":773094113280,"available":770640297984,"internally_reserved":0,"allocated":5074944,"data_stored":2800515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001731"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:30:31.778438+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:30:31.778438+0000","last_peered":"2024-08-17T02:30:31.778438+0000","last_clean":"2024-08-17T02:30:31.778438+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:30:31.778438+0000","last_undegraded":"2024-08-17T02:30:31.778438+0000","last_fullsized":"2024-08-17T02:30:31.778438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":206699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.177,"5min":1.306,"15min":1.306},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.84099999999999997,"15min":0.81699999999999995},"min":{"1min":0.65700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.94399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88900000000000001,"15min":0.85699999999999998},"min":{"1min":0.63800000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.446,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.74399999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.335,"5min":1.637,"15min":1.637},"last":1.246}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88900000000000001,"15min":0.86899999999999999},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.224,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.88100000000000001,"15min":0.87},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.85499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.98999999999999999,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92900000000000005,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.623}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89400000000000002,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.27,"5min":1.276,"15min":1.276},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.111}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4810000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0209999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.397,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.171,"15min":1.157},"min":{"1min":0.88200000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.417,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.373}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.88400000000000001,"15min":0.83499999999999996},"min":{"1min":0.64000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.069},{"interface":"front","average":{"1min":0.997,"5min":0.97499999999999998,"15min":0.96299999999999997},"min":{"1min":0.79000000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.206,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.135}]},{"osd":1,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.63,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88800000000000001},"min":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2090000000000001,"5min":1.349,"15min":1.349},"last":0.90200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.93899999999999995,"15min":0.95199999999999996},"min":{"1min":0.73199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1779999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.69499999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.99399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.68799999999999994,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.008,"15min":1.022},"min":{"1min":0.82699999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.355,"5min":1.536,"15min":1.536},"last":1.165}]},{"osd":4,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.417,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3380000000000001,"5min":1.448,"15min":1.448},"last":1.292}]},{"osd":5,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.125},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.359,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.256},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.71299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4890000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1439999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.385,"5min":1.536,"15min":1.536},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":1.048,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4990000000000001,"5min":2.194,"15min":2.194},"last":1.3360000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1081344,"data_stored":796044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.321,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.194,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96399999999999997,"15min":0.96199999999999997},"min":{"1min":0.77800000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.196,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97199999999999998,"15min":0.98199999999999998},"min":{"1min":0.73599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.258,"5min":2.105,"15min":2.105},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.72899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2909999999999999,"5min":2.153,"15min":2.153},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0649999999999999,"15min":1.095},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1459999999999999,"5min":1.919,"15min":1.919},"last":1.179}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.2050000000000001},"min":{"1min":0.752,"5min":0.623,"15min":0.623},"max":{"1min":1.2909999999999999,"5min":2.431,"15min":2.431},"last":1.056}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1240000000000001,"15min":1.1519999999999999},"min":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.353,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.02},{"interface":"front","average":{"1min":1.177,"5min":1.169,"15min":1.173},"min":{"1min":0.875,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5329999999999999,"5min":2.04,"15min":2.04},"last":1.262}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.194},"min":{"1min":0.84399999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.508,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.248,"15min":1.2769999999999999},"min":{"1min":0.95099999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.419,"5min":2.27,"15min":2.27},"last":1.294}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":202108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.93899999999999995,"15min":0.96299999999999997},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.141,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66300000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.69499999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.204},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.85699999999999998},"min":{"1min":0.64900000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1220000000000001,"5min":1.212,"15min":1.212},"last":1.097}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1850000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.0029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0269999999999999,"5min":1.266,"15min":1.266},"last":1.175},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2889999999999999,"5min":1.363,"15min":1.363},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2030000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.135,"15min":1.1919999999999999},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.1879999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.161,"15min":1.206},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.353,"5min":2.25,"15min":2.25},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.1839999999999999,"15min":1.1970000000000001},"min":{"1min":0.91700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2949999999999999,"5min":1.706,"15min":1.706},"last":1.135}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1830000000000001,"15min":1.238},"min":{"1min":0.80600000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.228,"5min":2.359,"15min":2.359},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5049999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":487424,"data_stored":202016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.69999999999999996},"min":{"1min":0.624,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.032}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.66100000000000003},"min":{"1min":0.502,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.113},"last":0.497}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.123,"5min":1.601,"15min":1.601},"last":0.71599999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0700000000000001,"5min":1.21,"15min":1.21},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.83799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1599999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1850000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0620000000000001,"15min":1.0609999999999999},"min":{"1min":0.90900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.24,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1160000000000001},"min":{"1min":0.92700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.272,"5min":1.768,"15min":1.768},"last":1.0589999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.415,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.149,"15min":1.137},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.476,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.95799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":200554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.502,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88200000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.093,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.629,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.95999999999999996,"5min":1.173,"15min":1.173},"last":1.0049999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.255,"15min":0.255},"max":{"1min":0.92300000000000004,"5min":1.143,"15min":1.143},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.70099999999999996,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0089999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.96599999999999997},"min":{"1min":0.90000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.534,"15min":1.534},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.018,"15min":0.99399999999999999},"min":{"1min":0.80900000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.0089999999999999},"min":{"1min":0.80300000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4079999999999999,"5min":1.476,"15min":1.476},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.0469999999999999},"min":{"1min":0.85299999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.167,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.048,"15min":1.0720000000000001},"min":{"1min":0.746,"5min":0.502,"15min":0.502},"max":{"1min":1.2709999999999999,"5min":1.823,"15min":1.823},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.91000000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3740000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.109,"15min":1.083},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.437},"max":{"1min":1.4990000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.98699999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1073152,"data_stored":790902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0880000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0649999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1140000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.022,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88100000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.016,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.3580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2609999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.81399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2350000000000001,"5min":1.26,"15min":1.26},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.095,"15min":1.1160000000000001},"min":{"1min":0.86599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4330000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.091,"15min":1.101},"min":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.25},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0980000000000001,"15min":1.109},"min":{"1min":0.89400000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.3500000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.0960000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.107,"15min":1.1220000000000001},"min":{"1min":0.86399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2809999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1799999999999999,"15min":1.204},"min":{"1min":0.80100000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6359999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0740000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.70199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56599999999999995,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.746},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84899999999999998,"15min":0.84199999999999997},"min":{"1min":0.66500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.823,"15min":1.823},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1040000000000001,"5min":1.367,"15min":1.367},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.96899999999999997},"min":{"1min":0.91800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.218}]},{"osd":5,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.86199999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3160000000000001,"5min":1.379,"15min":1.379},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.05,"15min":1.0449999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3420000000000001,"5min":1.768,"15min":1.768},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0900000000000001,"15min":1.093},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3380000000000001,"5min":1.913,"15min":1.913},"last":1.276},{"interface":"front","average":{"1min":1.129,"5min":1.0669999999999999,"15min":1.0449999999999999},"min":{"1min":0.84699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.087,"15min":1.075},"min":{"1min":0.874,"5min":0.75,"15min":0.75},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.026},{"interface":"front","average":{"1min":1.171,"5min":1.1020000000000001,"15min":1.0800000000000001},"min":{"1min":1.0029999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.944,"15min":1.944},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:41.173 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:30:41.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:41.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.272+0000 7f6ecbfff700 1 Processor -- start 2024-08-17T02:30:41.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.272+0000 7f6ecbfff700 1 -- start start 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.272+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0cbaa0 con 0x7f6ecc154900 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc157630 con 0x7f6ecc0b14a0 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc068790 con 0x7f6ecc0cb560 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecaffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6ecc154900 0x7f6ecc0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45296/0 (socket says 172.21.15.155:45296) 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecaffd700 1 -- 172.21.15.155:0/663501028 learned_addr learned my addr 172.21.15.155:0/663501028 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:41.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecb7fe700 1 --2- 172.21.15.155:0/663501028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177060015 0 0) 0x7f6ecc0cbaa0 con 0x7f6ecc154900 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8003570 con 0x7f6ecc154900 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023165374 0 0) 0x7f6ecc157630 con 0x7f6ecc0b14a0 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ecc0cbaa0 con 0x7f6ecc0b14a0 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/663501028 >> v1:172.21.15.189:6789/0 conn(0x7f6ecc0b14a0 legacy=0x7f6ecc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923115880 0 0) 0x7f6eb8003570 con 0x7f6ecc154900 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/663501028 >> v1:172.21.15.155:6789/0 conn(0x7f6ecc154900 legacy=0x7f6ecc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/663501028 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc157910 con 0x7f6ecc0cb560 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecb7fe700 1 --2- 172.21.15.155:0/663501028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc161ad0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009e90 tx=0x7f6ec4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f81706c67f23597e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e070 con 0x7f6ecc0cb560 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400b870 con 0x7f6ecc0cb560 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ec9ffb700 1 -- 172.21.15.155:0/663501028 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc001470 con 0x7f6ecc0cb560 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- 172.21.15.155:0/663501028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 msgr2=0x7f6ecc161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/663501028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc161ad0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009e90 tx=0x7f6ec4009780 comp rx=0 tx=0).stop 2024-08-17T02:30:41.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- 172.21.15.155:0/663501028 shutdown_connections 2024-08-17T02:30:41.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/663501028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc161ad0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- 172.21.15.155:0/663501028 >> 172.21.15.155:0/663501028 conn(0x7f6ecc0678d0 msgr2=0x7f6ecc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- 172.21.15.155:0/663501028 shutdown_connections 2024-08-17T02:30:41.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.276+0000 7f6ecbfff700 1 -- 172.21.15.155:0/663501028 wait complete. 2024-08-17T02:30:41.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.280+0000 7f6ecbfff700 1 Processor -- start 2024-08-17T02:30:41.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.280+0000 7f6ecbfff700 1 -- start start 2024-08-17T02:30:41.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ecc0b14a0 0x7f6ecc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc151040 con 0x7f6ecc154900 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc1675b0 con 0x7f6ecc0b14a0 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc167e50 con 0x7f6ecc0cb560 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39334/0 (socket says 172.21.15.155:39334) 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/607889157 learned_addr learned my addr 172.21.15.155:0/607889157 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecaffd700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ecc0b14a0 0x7f6ecc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6eca7fc700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 msgr2=0x7f6ecc1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ecc0b14a0 msgr2=0x7f6ecc156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ecc0b14a0 0x7f6ecc156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 -- 172.21.15.155:0/607889157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4009a20 con 0x7f6ecc154900 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecb7fe700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06c9b0 tx=0x7f6ec4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4012c20 con 0x7f6ecc154900 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4012da0 con 0x7f6ecc154900 2024-08-17T02:30:41.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc15c760 con 0x7f6ecc154900 2024-08-17T02:30:41.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40266b0 con 0x7f6ecc154900 2024-08-17T02:30:41.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc167ae0 con 0x7f6ecc154900 2024-08-17T02:30:41.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.284+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc0643a0 con 0x7f6ecc154900 2024-08-17T02:30:41.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.288+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ec401d440 con 0x7f6ecc154900 2024-08-17T02:30:41.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.288+0000 7f6ec2ffd700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 0x7f6eac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.288+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ec407ecc0 con 0x7f6ecc154900 2024-08-17T02:30:41.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.288+0000 7f6ecaffd700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 0x7f6eac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.288+0000 7f6ecaffd700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 0x7f6eac062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001ed0 tx=0x7f6ebc000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.296+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ec404f3b0 con 0x7f6ecc154900 2024-08-17T02:30:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.456+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ecc06f5f0 con 0x7f6eac060860 2024-08-17T02:30:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.460+0000 7f6ec2ffd700 1 -- 172.21.15.155:0/607889157 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48764 (secure 0 0 0) 0x7f6ecc06f5f0 con 0x7f6eac060860 2024-08-17T02:30:41.463 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 msgr2=0x7f6eac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 0x7f6eac062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001ed0 tx=0x7f6ebc000bc0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 msgr2=0x7f6ecc159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06c9b0 tx=0x7f6ec4017000 comp rx=0 tx=0).stop 2024-08-17T02:30:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 shutdown_connections 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6eac060860 0x7f6eac062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ecc154900 0x7f6ecc159ac0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ecc0cb560 0x7f6ecc1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 --2- 172.21.15.155:0/607889157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ecc0b14a0 0x7f6ecc156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 >> 172.21.15.155:0/607889157 conn(0x7f6ecc0678d0 msgr2=0x7f6ecc153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 shutdown_connections 2024-08-17T02:30:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.464+0000 7f6ecbfff700 1 -- 172.21.15.155:0/607889157 wait complete. 2024-08-17T02:30:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:30:41.478 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-08-17T02:30:40.011976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396304,"kb_used_data":4956,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578416,"statfs":{"total":773094113280,"available":770640297984,"internally_reserved":0,"allocated":5074944,"data_stored":2800515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001731"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:30:31.778438+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:30:31.778438+0000","last_peered":"2024-08-17T02:30:31.778438+0000","last_clean":"2024-08-17T02:30:31.778438+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:30:31.778438+0000","last_undegraded":"2024-08-17T02:30:31.778438+0000","last_fullsized":"2024-08-17T02:30:31.778438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:46.475994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":206699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.177,"5min":1.306,"15min":1.306},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.84099999999999997,"15min":0.81699999999999995},"min":{"1min":0.65700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.94399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88900000000000001,"15min":0.85699999999999998},"min":{"1min":0.63800000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.446,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.74399999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.335,"5min":1.637,"15min":1.637},"last":1.246}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88900000000000001,"15min":0.86899999999999999},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.224,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.88100000000000001,"15min":0.87},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.85499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.98999999999999999,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92900000000000005,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.623}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89400000000000002,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.27,"5min":1.276,"15min":1.276},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.111}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4810000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0209999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.397,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.171,"15min":1.157},"min":{"1min":0.88200000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.417,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.373}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.88400000000000001,"15min":0.83499999999999996},"min":{"1min":0.64000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.069},{"interface":"front","average":{"1min":0.997,"5min":0.97499999999999998,"15min":0.96299999999999997},"min":{"1min":0.79000000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.206,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.135}]},{"osd":1,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.63,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88800000000000001},"min":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2090000000000001,"5min":1.349,"15min":1.349},"last":0.90200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.93899999999999995,"15min":0.95199999999999996},"min":{"1min":0.73199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1779999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.69499999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.99399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.68799999999999994,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.008,"15min":1.022},"min":{"1min":0.82699999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.355,"5min":1.536,"15min":1.536},"last":1.165}]},{"osd":4,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.417,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3380000000000001,"5min":1.448,"15min":1.448},"last":1.292}]},{"osd":5,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.125},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.359,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.256},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.71299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4890000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1439999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.385,"5min":1.536,"15min":1.536},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":1.048,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4990000000000001,"5min":2.194,"15min":2.194},"last":1.3360000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1081344,"data_stored":796044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.321,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.194,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96399999999999997,"15min":0.96199999999999997},"min":{"1min":0.77800000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.196,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97199999999999998,"15min":0.98199999999999998},"min":{"1min":0.73599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.258,"5min":2.105,"15min":2.105},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.72899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2909999999999999,"5min":2.153,"15min":2.153},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0649999999999999,"15min":1.095},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1459999999999999,"5min":1.919,"15min":1.919},"last":1.179}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.2050000000000001},"min":{"1min":0.752,"5min":0.623,"15min":0.623},"max":{"1min":1.2909999999999999,"5min":2.431,"15min":2.431},"last":1.056}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1240000000000001,"15min":1.1519999999999999},"min":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.353,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.02},{"interface":"front","average":{"1min":1.177,"5min":1.169,"15min":1.173},"min":{"1min":0.875,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5329999999999999,"5min":2.04,"15min":2.04},"last":1.262}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.194},"min":{"1min":0.84399999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.508,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.248,"15min":1.2769999999999999},"min":{"1min":0.95099999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.419,"5min":2.27,"15min":2.27},"last":1.294}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":202108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.93899999999999995,"15min":0.96299999999999997},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.141,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66300000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.69499999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.204},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.85699999999999998},"min":{"1min":0.64900000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1220000000000001,"5min":1.212,"15min":1.212},"last":1.097}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1850000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.0029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0269999999999999,"5min":1.266,"15min":1.266},"last":1.175},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2889999999999999,"5min":1.363,"15min":1.363},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2030000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.135,"15min":1.1919999999999999},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.1879999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.161,"15min":1.206},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.353,"5min":2.25,"15min":2.25},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.1839999999999999,"15min":1.1970000000000001},"min":{"1min":0.91700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2949999999999999,"5min":1.706,"15min":1.706},"last":1.135}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1830000000000001,"15min":1.238},"min":{"1min":0.80600000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.228,"5min":2.359,"15min":2.359},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5049999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":487424,"data_stored":202016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.69999999999999996},"min":{"1min":0.624,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.032}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.66100000000000003},"min":{"1min":0.502,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.113},"last":0.497}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.123,"5min":1.601,"15min":1.601},"last":0.71599999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0700000000000001,"5min":1.21,"15min":1.21},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.83799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1599999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1850000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0620000000000001,"15min":1.0609999999999999},"min":{"1min":0.90900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.24,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1160000000000001},"min":{"1min":0.92700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.272,"5min":1.768,"15min":1.768},"last":1.0589999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.415,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.149,"15min":1.137},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.476,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.95799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":200554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.502,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88200000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.093,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.629,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.95999999999999996,"5min":1.173,"15min":1.173},"last":1.0049999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.255,"15min":0.255},"max":{"1min":0.92300000000000004,"5min":1.143,"15min":1.143},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.70099999999999996,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0089999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.96599999999999997},"min":{"1min":0.90000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.534,"15min":1.534},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.018,"15min":0.99399999999999999},"min":{"1min":0.80900000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.0089999999999999},"min":{"1min":0.80300000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4079999999999999,"5min":1.476,"15min":1.476},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.0469999999999999},"min":{"1min":0.85299999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.167,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.048,"15min":1.0720000000000001},"min":{"1min":0.746,"5min":0.502,"15min":0.502},"max":{"1min":1.2709999999999999,"5min":1.823,"15min":1.823},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.91000000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3740000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.109,"15min":1.083},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.437},"max":{"1min":1.4990000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.98699999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302564,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069276,"statfs":{"total":96636764160,"available":96326938624,"internally_reserved":0,"allocated":1073152,"data_stored":790902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0880000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0649999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1140000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.022,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88100000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.016,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.3580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2609999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.81399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2350000000000001,"5min":1.26,"15min":1.26},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.095,"15min":1.1160000000000001},"min":{"1min":0.86599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4330000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.091,"15min":1.101},"min":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.25},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0980000000000001,"15min":1.109},"min":{"1min":0.89400000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.3500000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.0960000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.107,"15min":1.1220000000000001},"min":{"1min":0.86399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2809999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1799999999999999,"15min":1.204},"min":{"1min":0.80100000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6359999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":1.0740000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301992,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069848,"statfs":{"total":96636764160,"available":96327524352,"internally_reserved":0,"allocated":483328,"data_stored":201124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.70199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56599999999999995,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.746},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84899999999999998,"15min":0.84199999999999997},"min":{"1min":0.66500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.823,"15min":1.823},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1040000000000001,"5min":1.367,"15min":1.367},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.96899999999999997},"min":{"1min":0.91800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.218}]},{"osd":5,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.86199999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3160000000000001,"5min":1.379,"15min":1.379},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.05,"15min":1.0449999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3420000000000001,"5min":1.768,"15min":1.768},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0900000000000001,"15min":1.093},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3380000000000001,"5min":1.913,"15min":1.913},"last":1.276},{"interface":"front","average":{"1min":1.129,"5min":1.0669999999999999,"15min":1.0449999999999999},"min":{"1min":0.84699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.087,"15min":1.075},"min":{"1min":0.874,"5min":0.75,"15min":0.75},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.026},{"interface":"front","average":{"1min":1.171,"5min":1.1020000000000001,"15min":1.0800000000000001},"min":{"1min":1.0029999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.944,"15min":1.944},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:41.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.580+0000 7fd0ff59e700 1 Processor -- start 2024-08-17T02:30:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.580+0000 7fd0ff59e700 1 -- start start 2024-08-17T02:30:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1000cd1b0 0x7fd1001536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd10015a190 0x7fd10015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10015a610 con 0x7fd100153320 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000ce430 con 0x7fd1000cd1b0 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10015dbd0 con 0x7fd10015a190 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1000cd1b0 0x7fd1001536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1000cd1b0 0x7fd1001536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39340/0 (socket says 172.21.15.155:39340) 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 -- 172.21.15.155:0/3367177204 learned_addr learned my addr 172.21.15.155:0/3367177204 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fed9d700 1 --2- 172.21.15.155:0/3367177204 >> v2:172.21.15.189:3300/0 conn(0x7fd10015a190 0x7fd10015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 -- 172.21.15.155:0/3367177204 >> v2:172.21.15.189:3300/0 conn(0x7fd10015a190 msgr2=0x7fd10015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 --2- 172.21.15.155:0/3367177204 >> v2:172.21.15.189:3300/0 conn(0x7fd10015a190 0x7fd10015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 -- 172.21.15.155:0/3367177204 >> v1:172.21.15.189:6789/0 conn(0x7fd100153320 legacy=0x7fd1000ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 -- 172.21.15.155:0/3367177204 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10015d370 con 0x7fd1000cd1b0 2024-08-17T02:30:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fdd9b700 1 --2- 172.21.15.155:0/3367177204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1000cd1b0 0x7fd1001536f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80099b0 tx=0x7fd0e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7717874b7aa6b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fd59a700 1 -- 172.21.15.155:0/3367177204 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800b820 con 0x7fd1000cd1b0 2024-08-17T02:30:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fd59a700 1 -- 172.21.15.155:0/3367177204 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800b980 con 0x7fd1000cd1b0 2024-08-17T02:30:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0fd59a700 1 -- 172.21.15.155:0/3367177204 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800bd20 con 0x7fd1000cd1b0 2024-08-17T02:30:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- 172.21.15.155:0/3367177204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1000cd1b0 msgr2=0x7fd1001536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/3367177204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1000cd1b0 0x7fd1001536f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80099b0 tx=0x7fd0e8009250 comp rx=0 tx=0).stop 2024-08-17T02:30:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- 172.21.15.155:0/3367177204 shutdown_connections 2024-08-17T02:30:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/3367177204 >> v2:172.21.15.189:3300/0 conn(0x7fd10015a190 0x7fd10015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/3367177204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1000cd1b0 0x7fd1001536f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- 172.21.15.155:0/3367177204 >> 172.21.15.155:0/3367177204 conn(0x7fd1000d00a0 msgr2=0x7fd1000d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- 172.21.15.155:0/3367177204 shutdown_connections 2024-08-17T02:30:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- 172.21.15.155:0/3367177204 wait complete. 2024-08-17T02:30:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 Processor -- start 2024-08-17T02:30:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.584+0000 7fd0ff59e700 1 -- start start 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1000cd1b0 0x7fd100147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd100153320 0x7fd1000b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000b5940 con 0x7fd10015a190 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000b4d30 con 0x7fd1000cd1b0 2024-08-17T02:30:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000b5010 con 0x7fd100153320 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39350/0 (socket says 172.21.15.155:39350) 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 -- 172.21.15.155:0/2348852839 learned_addr learned my addr 172.21.15.155:0/2348852839 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fdd9b700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd100153320 0x7fd1000b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fe59c700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1000cd1b0 0x7fd100147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 -- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd100153320 msgr2=0x7fd1000b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd100153320 0x7fd1000b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 -- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1000cd1b0 msgr2=0x7fd100147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1000cd1b0 0x7fd100147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 -- 172.21.15.155:0/2348852839 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80094f0 con 0x7fd10015a190 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0fed9d700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007f20 tx=0x7fd0f0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000eb90 con 0x7fd10015a190 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f000ed10 con 0x7fd10015a190 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1000b52f0 con 0x7fd10015a190 2024-08-17T02:30:41.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0014670 con 0x7fd10015a190 2024-08-17T02:30:41.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.588+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1000b1df0 con 0x7fd10015a190 2024-08-17T02:30:41.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1000b1fe0 con 0x7fd10015a190 2024-08-17T02:30:41.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd0f00149e0 con 0x7fd10015a190 2024-08-17T02:30:41.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0f67fc700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 0x7fd0e0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0fe59c700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 0x7fd0e0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd0f007cec0 con 0x7fd10015a190 2024-08-17T02:30:41.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.592+0000 7fd0fe59c700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 0x7fd0e0062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8003aa0 tx=0x7fd0f8000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.600+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd0f004d5b0 con 0x7fd10015a190 2024-08-17T02:30:41.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.764+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1000638f0 con 0x7fd10015a190 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.764+0000 7fd0f67fc700 1 -- 172.21.15.155:0/2348852839 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7fd0f0050bd0 con 0x7fd10015a190 2024-08-17T02:30:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:41.768 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":44,"fsid":"fa54bf99-d4c6-4ed9-b983-a07e3ced1452","created":"2024-08-17T02:27:05.677762+0000","modified":"2024-08-17T02:30:38.477007+0000","last_up_change":"2024-08-17T02:27:15.661249+0000","last_in_change":"2024-08-17T02:27:07.709880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:15.998578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c03ba931-eec1-4b1d-9254-59f448cd598d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":24217},{"type":"v1","addr":"172.21.15.155:6801","nonce":24217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":24217},{"type":"v1","addr":"172.21.15.155:6803","nonce":24217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":24217},{"type":"v1","addr":"172.21.15.155:6807","nonce":24217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":24217},{"type":"v1","addr":"172.21.15.155:6805","nonce":24217}]},"public_addr":"172.21.15.155:6801/24217","cluster_addr":"172.21.15.155:6803/24217","heartbeat_back_addr":"172.21.15.155:6807/24217","heartbeat_front_addr":"172.21.15.155:6805/24217","state":["exists","up"]},{"osd":1,"uuid":"f3ee7bae-60bd-4fc1-ad90-accd0612d750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":24219},{"type":"v1","addr":"172.21.15.155:6825","nonce":24219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":24219},{"type":"v1","addr":"172.21.15.155:6827","nonce":24219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":24219},{"type":"v1","addr":"172.21.15.155:6831","nonce":24219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":24219},{"type":"v1","addr":"172.21.15.155:6829","nonce":24219}]},"public_addr":"172.21.15.155:6825/24219","cluster_addr":"172.21.15.155:6827/24219","heartbeat_back_addr":"172.21.15.155:6831/24219","heartbeat_front_addr":"172.21.15.155:6829/24219","state":["exists","up"]},{"osd":2,"uuid":"a3056522-7876-479c-b2b5-f15703b32ff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":24220},{"type":"v1","addr":"172.21.15.155:6813","nonce":24220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":24220},{"type":"v1","addr":"172.21.15.155:6817","nonce":24220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":24220},{"type":"v1","addr":"172.21.15.155:6823","nonce":24220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":24220},{"type":"v1","addr":"172.21.15.155:6820","nonce":24220}]},"public_addr":"172.21.15.155:6813/24220","cluster_addr":"172.21.15.155:6817/24220","heartbeat_back_addr":"172.21.15.155:6823/24220","heartbeat_front_addr":"172.21.15.155:6820/24220","state":["exists","up"]},{"osd":3,"uuid":"363321d2-aa80-4ce5-ac56-436ed03a3d61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":24221},{"type":"v1","addr":"172.21.15.155:6809","nonce":24221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":24221},{"type":"v1","addr":"172.21.15.155:6812","nonce":24221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":24221},{"type":"v1","addr":"172.21.15.155:6821","nonce":24221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":24221},{"type":"v1","addr":"172.21.15.155:6816","nonce":24221}]},"public_addr":"172.21.15.155:6809/24221","cluster_addr":"172.21.15.155:6812/24221","heartbeat_back_addr":"172.21.15.155:6821/24221","heartbeat_front_addr":"172.21.15.155:6816/24221","state":["exists","up"]},{"osd":4,"uuid":"a36fcda1-cea7-4f09-9a2f-1673f034d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":24445},{"type":"v1","addr":"172.21.15.189:6809","nonce":24445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6811","nonce":24445},{"type":"v1","addr":"172.21.15.189:6813","nonce":24445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":24445},{"type":"v1","addr":"172.21.15.189:6823","nonce":24445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":24445},{"type":"v1","addr":"172.21.15.189:6818","nonce":24445}]},"public_addr":"172.21.15.189:6809/24445","cluster_addr":"172.21.15.189:6813/24445","heartbeat_back_addr":"172.21.15.189:6823/24445","heartbeat_front_addr":"172.21.15.189:6818/24445","state":["exists","up"]},{"osd":5,"uuid":"ad789d88-7793-43a5-88b9-9acfed2ca06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":24444},{"type":"v1","addr":"172.21.15.189:6801","nonce":24444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":24444},{"type":"v1","addr":"172.21.15.189:6803","nonce":24444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":24444},{"type":"v1","addr":"172.21.15.189:6807","nonce":24444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":24444},{"type":"v1","addr":"172.21.15.189:6805","nonce":24444}]},"public_addr":"172.21.15.189:6801/24444","cluster_addr":"172.21.15.189:6803/24444","heartbeat_back_addr":"172.21.15.189:6807/24444","heartbeat_front_addr":"172.21.15.189:6805/24444","state":["exists","up"]},{"osd":6,"uuid":"c9fd3af1-7e2f-40e2-b697-685927e6fe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":24446},{"type":"v1","addr":"172.21.15.189:6825","nonce":24446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":24446},{"type":"v1","addr":"172.21.15.189:6827","nonce":24446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":24446},{"type":"v1","addr":"172.21.15.189:6831","nonce":24446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":24446},{"type":"v1","addr":"172.21.15.189:6829","nonce":24446}]},"public_addr":"172.21.15.189:6825/24446","cluster_addr":"172.21.15.189:6827/24446","heartbeat_back_addr":"172.21.15.189:6831/24446","heartbeat_front_addr":"172.21.15.189:6829/24446","state":["exists","up"]},{"osd":7,"uuid":"c1934419-fccc-441a-b305-07333afa0584","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":24447},{"type":"v1","addr":"172.21.15.189:6812","nonce":24447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":24447},{"type":"v1","addr":"172.21.15.189:6815","nonce":24447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6821","nonce":24447},{"type":"v1","addr":"172.21.15.189:6822","nonce":24447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6817","nonce":24447},{"type":"v1","addr":"172.21.15.189:6819","nonce":24447}]},"public_addr":"172.21.15.189:6812/24447","cluster_addr":"172.21.15.189:6815/24447","heartbeat_back_addr":"172.21.15.189:6822/24447","heartbeat_front_addr":"172.21.15.189:6819/24447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.973824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.254202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737678+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.750192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.737230+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.610101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:13.190587+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:12.941743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:6835/1244813434":"2024-08-18T02:30:35.460322+0000","172.21.15.189:6834/1244813434":"2024-08-18T02:30:35.460322+0000","172.21.15.155:6837/2606343357":"2024-08-18T02:30:29.135388+0000","172.21.15.155:6836/2606343357":"2024-08-18T02:30:29.135388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:41.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 msgr2=0x7fd0e0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 0x7fd0e0062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8003aa0 tx=0x7fd0f8000bc0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 msgr2=0x7fd1000afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007f20 tx=0x7fd0f0009860 comp rx=0 tx=0).stop 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 shutdown_connections 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fd0e0060890 0x7fd0e0062d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10015a190 0x7fd1000afc60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd100153320 0x7fd1000b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 --2- 172.21.15.155:0/2348852839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1000cd1b0 0x7fd100147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 >> 172.21.15.155:0/2348852839 conn(0x7fd1000d00a0 msgr2=0x7fd100159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 shutdown_connections 2024-08-17T02:30:41.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:41.768+0000 7fd0ff59e700 1 -- 172.21.15.155:0/2348852839 wait complete. 2024-08-17T02:30:42.783 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:30:42.784 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:42.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.904+0000 7ff1d7828700 1 Processor -- start 2024-08-17T02:30:42.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.904+0000 7ff1d7828700 1 -- start start 2024-08-17T02:30:42.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1d0159500 0x7ff1d00cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d00d09c0 con 0x7ff1d00cf110 2024-08-17T02:30:42.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d015aab0 con 0x7ff1d0159500 2024-08-17T02:30:42.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00d0c10 con 0x7ff1d00ca850 2024-08-17T02:30:42.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1d0159500 0x7ff1d00cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1d0159500 0x7ff1d00cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39362/0 (socket says 172.21.15.155:39362) 2024-08-17T02:30:42.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 -- 172.21.15.155:0/1011136802 learned_addr learned my addr 172.21.15.155:0/1011136802 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:42.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d5dc5700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 -- 172.21.15.155:0/1011136802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 msgr2=0x7ff1d00cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 -- 172.21.15.155:0/1011136802 >> v1:172.21.15.189:6789/0 conn(0x7ff1d00cf110 legacy=0x7ff1d00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1c7fff700 1 -- 172.21.15.155:0/1011136802 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213265100 0 0) 0x7ff1d00d09c0 con 0x7ff1d00cf110 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 -- 172.21.15.155:0/1011136802 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00d0ef0 con 0x7ff1d0159500 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d55c4700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d0159500 0x7ff1d00cebd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3af0b7c637d8186 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1c7fff700 1 -- 172.21.15.155:0/1011136802 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0009ea0 con 0x7ff1d0159500 2024-08-17T02:30:42.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1c7fff700 1 -- 172.21.15.155:0/1011136802 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000b860 con 0x7ff1d0159500 2024-08-17T02:30:42.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1c7fff700 1 -- 172.21.15.155:0/1011136802 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000bc00 con 0x7ff1d0159500 2024-08-17T02:30:42.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- 172.21.15.155:0/1011136802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d0159500 msgr2=0x7ff1d00cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d0159500 0x7ff1d00cebd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0009250 comp rx=0 tx=0).stop 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- 172.21.15.155:0/1011136802 shutdown_connections 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 --2- 172.21.15.155:0/1011136802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d0159500 0x7ff1d00cebd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- 172.21.15.155:0/1011136802 >> 172.21.15.155:0/1011136802 conn(0x7ff1d0067590 msgr2=0x7ff1d00d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- 172.21.15.155:0/1011136802 shutdown_connections 2024-08-17T02:30:42.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.908+0000 7ff1d7828700 1 -- 172.21.15.155:0/1011136802 wait complete. 2024-08-17T02:30:42.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 Processor -- start 2024-08-17T02:30:42.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 -- start start 2024-08-17T02:30:42.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 0x7ff1d01556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0159500 0x7ff1d00c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c60a0 con 0x7ff1d00cf110 2024-08-17T02:30:42.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d016c950 con 0x7ff1d0159500 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d7828700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00ca660 con 0x7ff1d00ca850 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 0x7ff1d01556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 0x7ff1d01556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39378/0 (socket says 172.21.15.155:39378) 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 -- 172.21.15.155:0/3274555189 learned_addr learned my addr 172.21.15.155:0/3274555189 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d55c4700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d5dc5700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0159500 0x7ff1d00c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 -- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 msgr2=0x7ff1d00ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1d00ca850 0x7ff1d00ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 -- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0159500 msgr2=0x7ff1d00c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0159500 0x7ff1d00c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00094f0 con 0x7ff1d00cf110 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.912+0000 7ff1d4dc3700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 0x7ff1d01556f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c530 tx=0x7ff1cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc011590 con 0x7ff1d00cf110 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc0116f0 con 0x7ff1d00cf110 2024-08-17T02:30:42.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d0156710 con 0x7ff1d00cf110 2024-08-17T02:30:42.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc011ab0 con 0x7ff1d00cf110 2024-08-17T02:30:42.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d00c5520 con 0x7ff1d00cf110 2024-08-17T02:30:42.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1d00638f0 con 0x7ff1d00cf110 2024-08-17T02:30:42.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff1cc01b3b0 con 0x7ff1d00cf110 2024-08-17T02:30:42.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff1b4060860 0x7ff1b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1d55c4700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff1b4060860 0x7ff1b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.916+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff1cc07beb0 con 0x7ff1d00cf110 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1c57fa700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7ff1b4066750 0x7ff1b4068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1b4069210 con 0x7ff1b4066750 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1cc07e4f0 con 0x7ff1d00cf110 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1d5dc5700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7ff1b4066750 0x7ff1b4068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1d55c4700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff1b4060860 0x7ff1b4062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1d5dc5700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7ff1b4066750 0x7ff1b4068b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.920+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== osd.0 v2:172.21.15.155:6800/24217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff1b4069210 con 0x7ff1b4066750 2024-08-17T02:30:42.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 --> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1d00b2c30 con 0x7ff1b4066750 2024-08-17T02:30:42.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1c57fa700 1 -- 172.21.15.155:0/3274555189 <== osd.0 v2:172.21.15.155:6800/24217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff1d00b2c30 con 0x7ff1b4066750 2024-08-17T02:30:42.940 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:42.940 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:42.940 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:42.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7ff1b4066750 msgr2=0x7ff1b4068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6800/24217,v1:172.21.15.155:6801/24217] conn(0x7ff1b4066750 0x7ff1b4068b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff1b4060860 msgr2=0x7ff1b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7ff1b4060860 0x7ff1b4062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0017000 comp rx=0 tx=0).stop 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 msgr2=0x7ff1d01556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 --2- 172.21.15.155:0/3274555189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d00cf110 0x7ff1d01556f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c530 tx=0x7ff1cc00c8f0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d5dc5700 1 -- 172.21.15.155:0/3274555189 reap_dead start 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 shutdown_connections 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 >> 172.21.15.155:0/3274555189 conn(0x7ff1d0067590 msgr2=0x7ff1d00cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 shutdown_connections 2024-08-17T02:30:42.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:42.936+0000 7ff1d7828700 1 -- 172.21.15.155:0/3274555189 wait complete. 2024-08-17T02:30:42.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:30:43.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.064+0000 7fad837b4700 1 Processor -- start 2024-08-17T02:30:43.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.064+0000 7fad837b4700 1 -- start start 2024-08-17T02:30:43.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad837b4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad837b4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad7c0cb450 0x7fad7c06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad837b4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0cb890 con 0x7fad7c06e470 2024-08-17T02:30:43.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad837b4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c158290 con 0x7fad7c0cb450 2024-08-17T02:30:43.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad837b4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1610c0 con 0x7fad7c0adf10 2024-08-17T02:30:43.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad7c0cb450 0x7fad7c06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad80d4f700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fad7c06e470 0x7fad7c0cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45306/0 (socket says 172.21.15.155:45306) 2024-08-17T02:30:43.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad80d4f700 1 -- 172.21.15.155:0/3085226237 learned_addr learned my addr 172.21.15.155:0/3085226237 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:43.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81550700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad73fff700 1 -- 172.21.15.155:0/3085226237 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277405112 0 0) 0x7fad7c0cb890 con 0x7fad7c06e470 2024-08-17T02:30:43.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad73fff700 1 -- 172.21.15.155:0/3085226237 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad68003570 con 0x7fad7c06e470 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 -- 172.21.15.155:0/3085226237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 msgr2=0x7fad7c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 -- 172.21.15.155:0/3085226237 >> v1:172.21.15.155:6789/0 conn(0x7fad7c06e470 legacy=0x7fad7c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 -- 172.21.15.155:0/3085226237 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0ae820 con 0x7fad7c0cb450 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad81d51700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c0cb450 0x7fad7c06e8e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad74009e60 tx=0x7fad74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903eaf2145bf23b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad73fff700 1 -- 172.21.15.155:0/3085226237 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400e070 con 0x7fad7c0cb450 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad73fff700 1 -- 172.21.15.155:0/3085226237 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400bab0 con 0x7fad7c0cb450 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.068+0000 7fad73fff700 1 -- 172.21.15.155:0/3085226237 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400be70 con 0x7fad7c0cb450 2024-08-17T02:30:43.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- 172.21.15.155:0/3085226237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c0cb450 msgr2=0x7fad7c06e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c0cb450 0x7fad7c06e8e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad74009e60 tx=0x7fad74009780 comp rx=0 tx=0).stop 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- 172.21.15.155:0/3085226237 shutdown_connections 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c0cb450 0x7fad7c06e8e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 --2- 172.21.15.155:0/3085226237 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- 172.21.15.155:0/3085226237 >> 172.21.15.155:0/3085226237 conn(0x7fad7c067810 msgr2=0x7fad7c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- 172.21.15.155:0/3085226237 shutdown_connections 2024-08-17T02:30:43.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- 172.21.15.155:0/3085226237 wait complete. 2024-08-17T02:30:43.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 Processor -- start 2024-08-17T02:30:43.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.072+0000 7fad837b4700 1 -- start start 2024-08-17T02:30:43.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c1716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad7c0cb450 0x7fad7c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1439d0 con 0x7fad7c06e470 2024-08-17T02:30:43.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c159cd0 con 0x7fad7c0cb450 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c096fb0 con 0x7fad7c0adf10 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39398/0 (socket says 172.21.15.155:39398) 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 -- 172.21.15.155:0/1030213948 learned_addr learned my addr 172.21.15.155:0/1030213948 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad80d4f700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c1716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81d51700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad7c0cb450 0x7fad7c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 -- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 msgr2=0x7fad7c1716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c1716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 -- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad7c0cb450 msgr2=0x7fad7c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad7c0cb450 0x7fad7c15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 -- 172.21.15.155:0/1030213948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009a20 con 0x7fad7c06e470 2024-08-17T02:30:43.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad81550700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ec80 tx=0x7fad6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00c9d0 con 0x7fad7c06e470 2024-08-17T02:30:43.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00cb30 con 0x7fad7c06e470 2024-08-17T02:30:43.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c171c30 con 0x7fad7c06e470 2024-08-17T02:30:43.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c013470 con 0x7fad7c06e470 2024-08-17T02:30:43.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.076+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c096d50 con 0x7fad7c06e470 2024-08-17T02:30:43.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fad6c0137e0 con 0x7fad7c06e470 2024-08-17T02:30:43.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c0645c0 con 0x7fad7c06e470 2024-08-17T02:30:43.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad717fa700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 0x7fad60062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad80d4f700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 0x7fad60062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fad6c07cc70 con 0x7fad7c06e470 2024-08-17T02:30:43.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.080+0000 7fad80d4f700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 0x7fad60062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b1760 tx=0x7fad78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.088+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fad6c04d360 con 0x7fad7c06e470 2024-08-17T02:30:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7c06efa0 con 0x7fad60060860 2024-08-17T02:30:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad717fa700 1 -- 172.21.15.155:0/1030213948 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad7c06efa0 con 0x7fad60060860 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 msgr2=0x7fad60062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 0x7fad60062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b1760 tx=0x7fad78009040 comp rx=0 tx=0).stop 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 msgr2=0x7fad7c143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ec80 tx=0x7fad6c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 shutdown_connections 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fad60060860 0x7fad60062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad7c0cb450 0x7fad7c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad7c0adf10 0x7fad7c1716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 --2- 172.21.15.155:0/1030213948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad7c06e470 0x7fad7c143490 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 >> 172.21.15.155:0/1030213948 conn(0x7fad7c067810 msgr2=0x7fad7c0aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 shutdown_connections 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.248+0000 7fad837b4700 1 -- 172.21.15.155:0/1030213948 wait complete. 2024-08-17T02:30:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:30:43.264 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:30:43.265 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:43.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.376+0000 7fb253413700 1 Processor -- start 2024-08-17T02:30:43.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.376+0000 7fb253413700 1 -- start start 2024-08-17T02:30:43.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb24c0ce640 0x7fb24c0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0c5bb0 con 0x7fb24c0cea10 2024-08-17T02:30:43.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0c4fa0 con 0x7fb24c0cc400 2024-08-17T02:30:43.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0c5280 con 0x7fb24c0ce640 2024-08-17T02:30:43.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb252411700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb24c0ce640 0x7fb24c0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb251c10700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb24c0cea10 0x7fb24c0cbcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:45322/0 (socket says 172.21.15.155:45322) 2024-08-17T02:30:43.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb251c10700 1 -- 172.21.15.155:0/1974925767 learned_addr learned my addr 172.21.15.155:0/1974925767 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:43.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb252411700 1 -- 172.21.15.155:0/1974925767 >> v1:172.21.15.189:6789/0 conn(0x7fb24c0cc400 legacy=0x7fb24c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb252411700 1 -- 172.21.15.155:0/1974925767 >> v1:172.21.15.155:6789/0 conn(0x7fb24c0cea10 legacy=0x7fb24c0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb25140f700 1 -- 172.21.15.155:0/1974925767 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229437401 0 0) 0x7fb24c0c5bb0 con 0x7fb24c0cea10 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb252411700 1 -- 172.21.15.155:0/1974925767 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0c5560 con 0x7fb24c0ce640 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb252411700 1 --2- 172.21.15.155:0/1974925767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c0b2e70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0098e0 tx=0x7fb23c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5d367785d3a309 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb25140f700 1 -- 172.21.15.155:0/1974925767 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c009e80 con 0x7fb24c0ce640 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb25140f700 1 -- 172.21.15.155:0/1974925767 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00b860 con 0x7fb24c0ce640 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb25140f700 1 -- 172.21.15.155:0/1974925767 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00bbe0 con 0x7fb24c0ce640 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- 172.21.15.155:0/1974925767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 msgr2=0x7fb24c0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 --2- 172.21.15.155:0/1974925767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c0b2e70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0098e0 tx=0x7fb23c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- 172.21.15.155:0/1974925767 shutdown_connections 2024-08-17T02:30:43.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 --2- 172.21.15.155:0/1974925767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c0b2e70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- 172.21.15.155:0/1974925767 >> 172.21.15.155:0/1974925767 conn(0x7fb24c099410 msgr2=0x7fb24c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- 172.21.15.155:0/1974925767 shutdown_connections 2024-08-17T02:30:43.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- 172.21.15.155:0/1974925767 wait complete. 2024-08-17T02:30:43.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 Processor -- start 2024-08-17T02:30:43.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.380+0000 7fb253413700 1 -- start start 2024-08-17T02:30:43.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb24c0cc400 0x7fb24c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb24c0cea10 0x7fb24c157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c154200 con 0x7fb24c0ce640 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c153960 con 0x7fb24c0cc400 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c153c40 con 0x7fb24c0cea10 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39424/0 (socket says 172.21.15.155:39424) 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 -- 172.21.15.155:0/2091858405 learned_addr learned my addr 172.21.15.155:0/2091858405 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb252c12700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb24c0cea10 0x7fb24c157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb252411700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb24c0cc400 0x7fb24c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 -- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb24c0cea10 msgr2=0x7fb24c157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb24c0cea10 0x7fb24c157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 -- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb24c0cc400 msgr2=0x7fb24c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb24c0cc400 0x7fb24c151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb24c0ce640 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb251c10700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c157720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c560 tx=0x7fb248000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248005b30 con 0x7fb24c0ce640 2024-08-17T02:30:43.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248005c90 con 0x7fb24c0ce640 2024-08-17T02:30:43.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c153f20 con 0x7fb24c0ce640 2024-08-17T02:30:43.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248007320 con 0x7fb24c0ce640 2024-08-17T02:30:43.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.384+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c152090 con 0x7fb24c0ce640 2024-08-17T02:30:43.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb24801b3b0 con 0x7fb24c0ce640 2024-08-17T02:30:43.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb24c0c7690 con 0x7fb24c0ce640 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb230060860 0x7fb230062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb24807bdb0 con 0x7fb24c0ce640 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb252411700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb230060860 0x7fb230062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7fb230066750 0x7fb230068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb230069210 con 0x7fb230066750 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb24804c7d0 con 0x7fb24c0ce640 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb252c12700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7fb230066750 0x7fb230068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb252411700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb230060860 0x7fb230062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0093f0 tx=0x7fb23c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb252c12700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7fb230066750 0x7fb230068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.388+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== osd.1 v2:172.21.15.155:6824/24219 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb230069210 con 0x7fb230066750 2024-08-17T02:30:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 --> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb24c0644b0 con 0x7fb230066750 2024-08-17T02:30:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb2427fc700 1 -- 172.21.15.155:0/2091858405 <== osd.1 v2:172.21.15.155:6824/24219 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb24c0644b0 con 0x7fb230066750 2024-08-17T02:30:43.412 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:43.412 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:43.413 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7fb230066750 msgr2=0x7fb230068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6824/24219,v1:172.21.15.155:6825/24219] conn(0x7fb230066750 0x7fb230068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb230060860 msgr2=0x7fb230062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb230060860 0x7fb230062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0093f0 tx=0x7fb23c017000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 msgr2=0x7fb24c157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 --2- 172.21.15.155:0/2091858405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb24c0ce640 0x7fb24c157720 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c560 tx=0x7fb248000fe0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb252c12700 1 -- 172.21.15.155:0/2091858405 reap_dead start 2024-08-17T02:30:43.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 shutdown_connections 2024-08-17T02:30:43.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 >> 172.21.15.155:0/2091858405 conn(0x7fb24c099410 msgr2=0x7fb24c0c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 shutdown_connections 2024-08-17T02:30:43.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.408+0000 7fb253413700 1 -- 172.21.15.155:0/2091858405 wait complete. 2024-08-17T02:30:43.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:30:43.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 Processor -- start 2024-08-17T02:30:43.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- start start 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f55680b0d20 0x7f556806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f556806e450 0x7f55680b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5568141a00 con 0x7f55680b1630 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556806e8a0 con 0x7f556806e450 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5568140b10 con 0x7f55680b0d20 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f556806e450 0x7f55680b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f556806e450 0x7f55680b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42458/0 (socket says 172.21.15.155:42458) 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 -- 172.21.15.155:0/118259212 learned_addr learned my addr 172.21.15.155:0/118259212 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556659c700 1 --2- 172.21.15.155:0/118259212 >> v2:172.21.15.189:3300/0 conn(0x7f55680b0d20 0x7f556806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 -- 172.21.15.155:0/118259212 >> v2:172.21.15.189:3300/0 conn(0x7f55680b0d20 msgr2=0x7f556806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 --2- 172.21.15.155:0/118259212 >> v2:172.21.15.189:3300/0 conn(0x7f55680b0d20 0x7f556806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 -- 172.21.15.155:0/118259212 >> v1:172.21.15.189:6789/0 conn(0x7f55680b1630 legacy=0x7f55681610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 -- 172.21.15.155:0/118259212 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568140df0 con 0x7f556806e450 2024-08-17T02:30:43.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f5565d9b700 1 --2- 172.21.15.155:0/118259212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556806e450 0x7f55680b10f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f556806bd20 tx=0x7f5558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd2db2d791e02b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556559a700 1 -- 172.21.15.155:0/118259212 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800e070 con 0x7f556806e450 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556559a700 1 -- 172.21.15.155:0/118259212 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800ba50 con 0x7f556806e450 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556559a700 1 -- 172.21.15.155:0/118259212 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55580092e0 con 0x7f556806e450 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- 172.21.15.155:0/118259212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556806e450 msgr2=0x7f55680b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 --2- 172.21.15.155:0/118259212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556806e450 0x7f55680b10f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f556806bd20 tx=0x7f5558009840 comp rx=0 tx=0).stop 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- 172.21.15.155:0/118259212 shutdown_connections 2024-08-17T02:30:43.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 --2- 172.21.15.155:0/118259212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556806e450 0x7f55680b10f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 --2- 172.21.15.155:0/118259212 >> v2:172.21.15.189:3300/0 conn(0x7f55680b0d20 0x7f556806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- 172.21.15.155:0/118259212 >> 172.21.15.155:0/118259212 conn(0x7f55680678d0 msgr2=0x7f5568067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- 172.21.15.155:0/118259212 shutdown_connections 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.536+0000 7f556759e700 1 -- 172.21.15.155:0/118259212 wait complete. 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 Processor -- start 2024-08-17T02:30:43.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- start start 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f556806e450 0x7f55681576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55680b1630 0x7f556816e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5568156430 con 0x7f55680b0d20 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55681552f0 con 0x7f55680b1630 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5568157220 con 0x7f556806e450 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42464/0 (socket says 172.21.15.155:42464) 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 -- 172.21.15.155:0/349871372 learned_addr learned my addr 172.21.15.155:0/349871372 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5566d9d700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55680b1630 0x7f556816e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556659c700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f556806e450 0x7f55681576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 -- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f556806e450 msgr2=0x7f55681576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f556806e450 0x7f55681576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 -- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55680b1630 msgr2=0x7f556816e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55680b1630 0x7f556816e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 -- 172.21.15.155:0/349871372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009ae0 con 0x7f55680b0d20 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f5565d9b700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f556806c2d0 tx=0x7f5558018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558008ac0 con 0x7f55680b0d20 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558008c40 con 0x7f55680b0d20 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5568156610 con 0x7f55680b0d20 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555801c410 con 0x7f55680b0d20 2024-08-17T02:30:43.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.540+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5568156bd0 con 0x7f55680b0d20 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55681573d0 con 0x7f55680b0d20 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5558003040 con 0x7f55680b0d20 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f555e7fc700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 0x7f5548062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f555807e0d0 con 0x7f55680b0d20 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f556659c700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 0x7f5548062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.544+0000 7f556659c700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 0x7f5548062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.552+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f55681573d0 con 0x7f55680b0d20 2024-08-17T02:30:43.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5568157390 con 0x7f5548060860 2024-08-17T02:30:43.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f555e7fc700 1 -- 172.21.15.155:0/349871372 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5568157390 con 0x7f5548060860 2024-08-17T02:30:43.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 msgr2=0x7f5548062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 0x7f5548062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550008040 comp rx=0 tx=0).stop 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 msgr2=0x7f5568146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f556806c2d0 tx=0x7f5558018000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 shutdown_connections 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f5548060860 0x7f5548062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55680b1630 0x7f556816e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55680b0d20 0x7f5568146640 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f556806c2d0 tx=0x7f5558018000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 --2- 172.21.15.155:0/349871372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f556806e450 0x7f55681576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 >> 172.21.15.155:0/349871372 conn(0x7f55680678d0 msgr2=0x7f556815ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 shutdown_connections 2024-08-17T02:30:43.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.716+0000 7f556759e700 1 -- 172.21.15.155:0/349871372 wait complete. 2024-08-17T02:30:43.722 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:30:43.732 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:30:43.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:43.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 Processor -- start 2024-08-17T02:30:43.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 -- start start 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b806dbf0 con 0x7f91b80abc00 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b80ae820 con 0x7f91b8140730 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91bc9d5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80ac020 con 0x7f91b8140360 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b659c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.155:48980/0 (socket says 172.21.15.155:48980) 2024-08-17T02:30:43.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b659c700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.155:59316/0 (socket says 172.21.15.155:59316) 2024-08-17T02:30:43.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3292112099 learned_addr learned my addr 172.21.15.155:0/3292112099 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3292112099 >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 msgr2=0x7f91b80ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 --2- 172.21.15.155:0/3292112099 >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3292112099 >> v1:172.21.15.189:6789/0 conn(0x7f91b80abc00 legacy=0x7f91b80ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3292112099 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b806d2c0 con 0x7f91b8140360 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b659c700 1 --2- 172.21.15.155:0/3292112099 >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b6d9d700 1 --2- 172.21.15.155:0/3292112099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91a00099b0 tx=0x7f91a0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8299d76879df1d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b5d9b700 1 -- 172.21.15.155:0/3292112099 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0009ea0 con 0x7f91b8140360 2024-08-17T02:30:43.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.844+0000 7f91b5d9b700 1 -- 172.21.15.155:0/3292112099 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000b860 con 0x7f91b8140360 2024-08-17T02:30:43.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91b5d9b700 1 -- 172.21.15.155:0/3292112099 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000bc00 con 0x7f91b8140360 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3292112099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 msgr2=0x7f91b80aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3292112099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91a00099b0 tx=0x7f91a0009250 comp rx=0 tx=0).stop 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3292112099 shutdown_connections 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3292112099 >> v2:172.21.15.189:3300/0 conn(0x7f91b8140730 0x7f91b80ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3292112099 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b80aee90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3292112099 >> 172.21.15.155:0/3292112099 conn(0x7f91b8066e00 msgr2=0x7f91b8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3292112099 shutdown_connections 2024-08-17T02:30:43.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3292112099 wait complete. 2024-08-17T02:30:43.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 Processor -- start 2024-08-17T02:30:43.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- start start 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 0x7f91b806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91b8140730 0x7f91b8154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b81607b0 con 0x7f91b80abc00 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b815f920 con 0x7f91b8140730 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91bc9d5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8154cc0 con 0x7f91b8140360 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.848+0000 7f91b6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 0x7f91b806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 0x7f91b806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42468/0 (socket says 172.21.15.155:42468) 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3234190015 learned_addr learned my addr 172.21.15.155:0/3234190015 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b659c700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b759e700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91b8140730 0x7f91b8154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3234190015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 msgr2=0x7f91b815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91b8140360 0x7f91b815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3234190015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91b8140730 msgr2=0x7f91b8154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91b8140730 0x7f91b8154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009420 con 0x7f91b80abc00 2024-08-17T02:30:43.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91b6d9d700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 0x7f91b806aa50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000bbe0 con 0x7f91b80abc00 2024-08-17T02:30:43.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a00094f0 con 0x7f91b80abc00 2024-08-17T02:30:43.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0000c90 con 0x7f91b80abc00 2024-08-17T02:30:43.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0011650 con 0x7f91b80abc00 2024-08-17T02:30:43.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b815fe80 con 0x7f91b80abc00 2024-08-17T02:30:43.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91b80644b0 con 0x7f91b80abc00 2024-08-17T02:30:43.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91a0011a40 con 0x7f91b80abc00 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.852+0000 7f91aeffd700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9198060860 0x7f9198062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f91a007e1b0 con 0x7f91b80abc00 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91b659c700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9198060860 0x7f9198062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91aeffd700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7f9198066750 0x7f9198068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9198069210 con 0x7f9198066750 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91a00807f0 con 0x7f91b80abc00 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91b759e700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7f9198066750 0x7f9198068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91b659c700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9198060860 0x7f9198062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91b813e680 tx=0x7f91a80091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91b759e700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7f9198066750 0x7f9198068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.856+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== osd.2 v2:172.21.15.155:6811/24220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9198069210 con 0x7f9198066750 2024-08-17T02:30:43.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.868+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 --> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91b80ab980 con 0x7f9198066750 2024-08-17T02:30:43.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.868+0000 7f91aeffd700 1 -- 172.21.15.155:0/3234190015 <== osd.2 v2:172.21.15.155:6811/24220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f91b80ab980 con 0x7f9198066750 2024-08-17T02:30:43.873 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:43.873 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:43.873 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:43.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.868+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7f9198066750 msgr2=0x7f9198068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.868+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6811/24220,v1:172.21.15.155:6813/24220] conn(0x7f9198066750 0x7f9198068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9198060860 msgr2=0x7f9198062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f9198060860 0x7f9198062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91b813e680 tx=0x7f91a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 msgr2=0x7f91b806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 --2- 172.21.15.155:0/3234190015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80abc00 0x7f91b806aa50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0017000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91b759e700 1 -- 172.21.15.155:0/3234190015 reap_dead start 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 shutdown_connections 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 >> 172.21.15.155:0/3234190015 conn(0x7f91b8066e00 msgr2=0x7f91b80aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 shutdown_connections 2024-08-17T02:30:43.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.872+0000 7f91bc9d5700 1 -- 172.21.15.155:0/3234190015 wait complete. 2024-08-17T02:30:43.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:30:44.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.996+0000 7f6ede041700 1 Processor -- start 2024-08-17T02:30:44.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:43.996+0000 7f6ede041700 1 -- start start 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6ed8153a70 0x7f6ed8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ed8153e40 0x7f6ed806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed8157810 con 0x7f6ed815a180 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed8157dd0 con 0x7f6ed8153e40 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed815a700 con 0x7f6ed8153a70 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ed8153e40 0x7f6ed806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed7fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6ed815a180 0x7f6ed80a9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44034/0 (socket says 172.21.15.155:44034) 2024-08-17T02:30:44.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ed8153e40 0x7f6ed806e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42478/0 (socket says 172.21.15.155:42478) 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed7fff700 1 -- 172.21.15.155:0/1745229622 learned_addr learned my addr 172.21.15.155:0/1745229622 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed77fe700 1 --2- 172.21.15.155:0/1745229622 >> v2:172.21.15.189:3300/0 conn(0x7f6ed8153a70 0x7f6ed8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 -- 172.21.15.155:0/1745229622 >> v2:172.21.15.189:3300/0 conn(0x7f6ed8153a70 msgr2=0x7f6ed8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 --2- 172.21.15.155:0/1745229622 >> v2:172.21.15.189:3300/0 conn(0x7f6ed8153a70 0x7f6ed8159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 -- 172.21.15.155:0/1745229622 >> v1:172.21.15.155:6789/0 conn(0x7f6ed815a180 legacy=0x7f6ed80a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 -- 172.21.15.155:0/1745229622 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed815a9e0 con 0x7f6ed8153e40 2024-08-17T02:30:44.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed67fc700 1 -- 172.21.15.155:0/1745229622 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799845447 0 0) 0x7f6ed8157810 con 0x7f6ed815a180 2024-08-17T02:30:44.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed6ffd700 1 --2- 172.21.15.155:0/1745229622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153e40 0x7f6ed806e2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b4c0 tx=0x7f6ec8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b642f40c723fb942 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed67fc700 1 -- 172.21.15.155:0/1745229622 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800e070 con 0x7f6ed8153e40 2024-08-17T02:30:44.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed67fc700 1 -- 172.21.15.155:0/1745229622 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800bb60 con 0x7f6ed8153e40 2024-08-17T02:30:44.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ed67fc700 1 -- 172.21.15.155:0/1745229622 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8012430 con 0x7f6ed8153e40 2024-08-17T02:30:44.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- 172.21.15.155:0/1745229622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153e40 msgr2=0x7f6ed806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 --2- 172.21.15.155:0/1745229622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153e40 0x7f6ed806e2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b4c0 tx=0x7f6ec8009780 comp rx=0 tx=0).stop 2024-08-17T02:30:44.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- 172.21.15.155:0/1745229622 shutdown_connections 2024-08-17T02:30:44.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 --2- 172.21.15.155:0/1745229622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153e40 0x7f6ed806e2b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 --2- 172.21.15.155:0/1745229622 >> v2:172.21.15.189:3300/0 conn(0x7f6ed8153a70 0x7f6ed8159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- 172.21.15.155:0/1745229622 >> 172.21.15.155:0/1745229622 conn(0x7f6ed8067810 msgr2=0x7f6ed8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- 172.21.15.155:0/1745229622 shutdown_connections 2024-08-17T02:30:44.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.000+0000 7f6ede041700 1 -- 172.21.15.155:0/1745229622 wait complete. 2024-08-17T02:30:44.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 Processor -- start 2024-08-17T02:30:44.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- start start 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed8153e40 0x7f6ed80987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ed815a180 0x7f6ed8152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8097380 con 0x7f6ed8153a70 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8096a90 con 0x7f6ed8153e40 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8096d30 con 0x7f6ed815a180 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42486/0 (socket says 172.21.15.155:42486) 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 -- 172.21.15.155:0/2796011079 learned_addr learned my addr 172.21.15.155:0/2796011079 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed7fff700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ed815a180 0x7f6ed8152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 -- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ed815a180 msgr2=0x7f6ed8152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ed815a180 0x7f6ed8152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 -- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed8153e40 msgr2=0x7f6ed80987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed8153e40 0x7f6ed80987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 -- 172.21.15.155:0/2796011079 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8009a20 con 0x7f6ed8153a70 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ed77fe700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e930 tx=0x7f6ecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00eed0 con 0x7f6ed8153a70 2024-08-17T02:30:44.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc00c850 con 0x7f6ed8153a70 2024-08-17T02:30:44.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8097010 con 0x7f6ed8153a70 2024-08-17T02:30:44.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00cbf0 con 0x7f6ed8153a70 2024-08-17T02:30:44.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.004+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed8097810 con 0x7f6ed8153a70 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed80645c0 con 0x7f6ed8153a70 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ecc013470 con 0x7f6ed8153a70 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ebf7fe700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 0x7f6ec4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ecc07cc30 con 0x7f6ed8153a70 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ed6ffd700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 0x7f6ec4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.008+0000 7f6ed6ffd700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 0x7f6ec4062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b4c0 tx=0x7f6ec8019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.020+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ecc050db0 con 0x7f6ed8153a70 2024-08-17T02:30:44.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.180+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ed8099e80 con 0x7f6ec4060860 2024-08-17T02:30:44.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ebf7fe700 1 -- 172.21.15.155:0/2796011079 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ed8099e80 con 0x7f6ec4060860 2024-08-17T02:30:44.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 msgr2=0x7f6ec4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 0x7f6ec4062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b4c0 tx=0x7f6ec8019000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 msgr2=0x7f6ed8169cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e930 tx=0x7f6ecc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 shutdown_connections 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6ec4060860 0x7f6ec4062d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6ed815a180 0x7f6ed8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed8153e40 0x7f6ed80987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 --2- 172.21.15.155:0/2796011079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ed8153a70 0x7f6ed8169cc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 >> 172.21.15.155:0/2796011079 conn(0x7f6ed8067810 msgr2=0x7f6ed8158160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 shutdown_connections 2024-08-17T02:30:44.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.184+0000 7f6ede041700 1 -- 172.21.15.155:0/2796011079 wait complete. 2024-08-17T02:30:44.191 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:30:44.204 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:30:44.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:44.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.312+0000 7f68c359e700 1 Processor -- start 2024-08-17T02:30:44.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.312+0000 7f68c359e700 1 -- start start 2024-08-17T02:30:44.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68c413f7f0 0x7f68c40ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c359e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f68c406f1d0 0x7f68c40c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40b0660 con 0x7f68c413fbc0 2024-08-17T02:30:44.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40abdc0 con 0x7f68c413f7f0 2024-08-17T02:30:44.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c359e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40b0af0 con 0x7f68c406f1d0 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68c413f7f0 0x7f68c40ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c1d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f68c413fbc0 0x7f68c406eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44050/0 (socket says 172.21.15.155:44050) 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68c413f7f0 0x7f68c40ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42498/0 (socket says 172.21.15.155:42498) 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c1d9b700 1 -- 172.21.15.155:0/3389517486 learned_addr learned my addr 172.21.15.155:0/3389517486 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c2d9d700 1 --2- 172.21.15.155:0/3389517486 >> v2:172.21.15.189:3300/0 conn(0x7f68c406f1d0 0x7f68c40c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c159a700 1 -- 172.21.15.155:0/3389517486 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101660302 0 0) 0x7f68c40b0660 con 0x7f68c413fbc0 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c159a700 1 -- 172.21.15.155:0/3389517486 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ac003570 con 0x7f68c413fbc0 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 -- 172.21.15.155:0/3389517486 >> v2:172.21.15.189:3300/0 conn(0x7f68c406f1d0 msgr2=0x7f68c40c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 --2- 172.21.15.155:0/3389517486 >> v2:172.21.15.189:3300/0 conn(0x7f68c406f1d0 0x7f68c40c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 -- 172.21.15.155:0/3389517486 >> v1:172.21.15.155:6789/0 conn(0x7f68c413fbc0 legacy=0x7f68c406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 -- 172.21.15.155:0/3389517486 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40afd30 con 0x7f68c413f7f0 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c259c700 1 --2- 172.21.15.155:0/3389517486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413f7f0 0x7f68c40ab6c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ae2e0 tx=0x7f68b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397640129ef8fcbc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c159a700 1 -- 172.21.15.155:0/3389517486 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8011630 con 0x7f68c413f7f0 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c159a700 1 -- 172.21.15.155:0/3389517486 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b8011790 con 0x7f68c413f7f0 2024-08-17T02:30:44.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.316+0000 7f68c159a700 1 -- 172.21.15.155:0/3389517486 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8011b30 con 0x7f68c413f7f0 2024-08-17T02:30:44.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- 172.21.15.155:0/3389517486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413f7f0 msgr2=0x7f68c40ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 --2- 172.21.15.155:0/3389517486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413f7f0 0x7f68c40ab6c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ae2e0 tx=0x7f68b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- 172.21.15.155:0/3389517486 shutdown_connections 2024-08-17T02:30:44.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 --2- 172.21.15.155:0/3389517486 >> v2:172.21.15.189:3300/0 conn(0x7f68c406f1d0 0x7f68c40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 --2- 172.21.15.155:0/3389517486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413f7f0 0x7f68c40ab6c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- 172.21.15.155:0/3389517486 >> 172.21.15.155:0/3389517486 conn(0x7f68c4066e00 msgr2=0x7f68c4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- 172.21.15.155:0/3389517486 shutdown_connections 2024-08-17T02:30:44.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- 172.21.15.155:0/3389517486 wait complete. 2024-08-17T02:30:44.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 Processor -- start 2024-08-17T02:30:44.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.320+0000 7f68c359e700 1 -- start start 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c406f1d0 0x7f68c415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68c413f7f0 0x7f68c40aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 0x7f68c40aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40a5450 con 0x7f68c413fbc0 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40a56a0 con 0x7f68c406f1d0 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40a5980 con 0x7f68c413f7f0 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 0x7f68c40aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 0x7f68c40aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42502/0 (socket says 172.21.15.155:42502) 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 -- 172.21.15.155:0/2302763345 learned_addr learned my addr 172.21.15.155:0/2302763345 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c259c700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c406f1d0 0x7f68c415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c1d9b700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68c413f7f0 0x7f68c40aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 -- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68c413f7f0 msgr2=0x7f68c40aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f68c413f7f0 0x7f68c40aa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 -- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c406f1d0 msgr2=0x7f68c415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c406f1d0 0x7f68c415ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009420 con 0x7f68c413fbc0 2024-08-17T02:30:44.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c2d9d700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 0x7f68c40aa5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009ec0 tx=0x7f68bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00cb70 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00f040 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40a5c60 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc014480 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40a6220 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.324+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68c40644b0 con 0x7f68c413fbc0 2024-08-17T02:30:44.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f68bc0147f0 con 0x7f68c413fbc0 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f68a4060860 0x7f68a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68c259c700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f68a4060860 0x7f68a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f68bc07de60 con 0x7f68c413fbc0 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f68a4066750 0x7f68a4068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a4069210 con 0x7f68a4066750 2024-08-17T02:30:44.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68bc07e230 con 0x7f68c413fbc0 2024-08-17T02:30:44.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68c1d9b700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f68a4066750 0x7f68a4068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68c259c700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f68a4060860 0x7f68a4062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009860 tx=0x7f68b8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.328+0000 7f68c1d9b700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f68a4066750 0x7f68a4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.332+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== osd.3 v2:172.21.15.155:6808/24221 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f68a4069210 con 0x7f68a4066750 2024-08-17T02:30:44.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 --> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68c40cb890 con 0x7f68a4066750 2024-08-17T02:30:44.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68b27fc700 1 -- 172.21.15.155:0/2302763345 <== osd.3 v2:172.21.15.155:6808/24221 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f68c40cb890 con 0x7f68a4066750 2024-08-17T02:30:44.351 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:44.352 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:44.352 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:44.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f68a4066750 msgr2=0x7f68a4068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6808/24221,v1:172.21.15.155:6809/24221] conn(0x7f68a4066750 0x7f68a4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f68a4060860 msgr2=0x7f68a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f68a4060860 0x7f68a4062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009860 tx=0x7f68b8017000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 msgr2=0x7f68c40aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 --2- 172.21.15.155:0/2302763345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c413fbc0 0x7f68c40aa5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009ec0 tx=0x7f68bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c2d9d700 1 -- 172.21.15.155:0/2302763345 reap_dead start 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 shutdown_connections 2024-08-17T02:30:44.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 >> 172.21.15.155:0/2302763345 conn(0x7f68c4066e00 msgr2=0x7f68c4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 shutdown_connections 2024-08-17T02:30:44.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.348+0000 7f68c359e700 1 -- 172.21.15.155:0/2302763345 wait complete. 2024-08-17T02:30:44.363 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:30:44.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 Processor -- start 2024-08-17T02:30:44.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 -- start start 2024-08-17T02:30:44.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f42dc0aedf0 0x7f42dc0af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0c95f0 con 0x7f42dc067690 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0b28c0 con 0x7f42dc1571c0 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.468+0000 7f42db59e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0b1f90 con 0x7f42dc0aedf0 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d1d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f42dc067690 0x7f42dc156ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44058/0 (socket says 172.21.15.155:44058) 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d1d9b700 1 -- 172.21.15.155:0/2819061329 learned_addr learned my addr 172.21.15.155:0/2819061329 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42da59c700 1 --2- 172.21.15.155:0/2819061329 >> v2:172.21.15.189:3300/0 conn(0x7f42dc0aedf0 0x7f42dc0af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144409348 0 0) 0x7f42dc0c95f0 con 0x7f42dc067690 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c8003570 con 0x7f42dc067690 2024-08-17T02:30:44.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970931984 0 0) 0x7f42dc0b28c0 con 0x7f42dc1571c0 2024-08-17T02:30:44.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42dc0c95f0 con 0x7f42dc1571c0 2024-08-17T02:30:44.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766627782 0 0) 0x7f42c8003570 con 0x7f42dc067690 2024-08-17T02:30:44.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42da59c700 1 -- 172.21.15.155:0/2819061329 >> v1:172.21.15.189:6789/0 conn(0x7f42dc1571c0 legacy=0x7f42dc069b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42da59c700 1 -- 172.21.15.155:0/2819061329 >> v1:172.21.15.155:6789/0 conn(0x7f42dc067690 legacy=0x7f42dc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42da59c700 1 -- 172.21.15.155:0/2819061329 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0b2270 con 0x7f42dc0aedf0 2024-08-17T02:30:44.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42da59c700 1 --2- 172.21.15.155:0/2819061329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc0aedf0 0x7f42dc0af1c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0098e0 tx=0x7f42cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78aa0e5fe6afdf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4001470 con 0x7f42dc0aedf0 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc011420 con 0x7f42dc0aedf0 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42d9d9b700 1 -- 172.21.15.155:0/2819061329 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0117c0 con 0x7f42dc0aedf0 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 -- 172.21.15.155:0/2819061329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc0aedf0 msgr2=0x7f42dc0af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 --2- 172.21.15.155:0/2819061329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc0aedf0 0x7f42dc0af1c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0098e0 tx=0x7f42cc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 -- 172.21.15.155:0/2819061329 shutdown_connections 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 --2- 172.21.15.155:0/2819061329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc0aedf0 0x7f42dc0af1c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 -- 172.21.15.155:0/2819061329 >> 172.21.15.155:0/2819061329 conn(0x7f42dc0ca2b0 msgr2=0x7f42dc06e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 -- 172.21.15.155:0/2819061329 shutdown_connections 2024-08-17T02:30:44.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.472+0000 7f42db59e700 1 -- 172.21.15.155:0/2819061329 wait complete. 2024-08-17T02:30:44.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 Processor -- start 2024-08-17T02:30:44.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 -- start start 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 0x7f42dc169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 0x7f42dc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc16db80 con 0x7f42dc0aedf0 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc16cf70 con 0x7f42dc067690 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42db59e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc16d250 con 0x7f42dc1571c0 2024-08-17T02:30:44.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42504/0 (socket says 172.21.15.155:42504) 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 -- 172.21.15.155:0/1044468777 learned_addr learned my addr 172.21.15.155:0/1044468777 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42da59c700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 0x7f42dc169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42dad9d700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 0x7f42dc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 -- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 msgr2=0x7f42dc14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 0x7f42dc14f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 -- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 msgr2=0x7f42dc169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 0x7f42dc169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 -- 172.21.15.155:0/1044468777 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009420 con 0x7f42dc0aedf0 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42dad9d700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 0x7f42dc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42da59c700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 0x7f42dc169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d1d9b700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f42c400cb70 tx=0x7f42c4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.476+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4007360 con 0x7f42dc0aedf0 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c40074e0 con 0x7f42dc0aedf0 2024-08-17T02:30:44.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc16d530 con 0x7f42dc0aedf0 2024-08-17T02:30:44.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4004830 con 0x7f42dc0aedf0 2024-08-17T02:30:44.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc169760 con 0x7f42dc0aedf0 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc16dcf0 con 0x7f42dc0aedf0 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f42c4004ba0 con 0x7f42dc0aedf0 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42d2ffd700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 0x7f42bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f42c407bda0 con 0x7f42dc0aedf0 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.480+0000 7f42da59c700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 0x7f42bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.484+0000 7f42da59c700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 0x7f42bc062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0093f0 tx=0x7f42cc016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.492+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f42c404c490 con 0x7f42dc0aedf0 2024-08-17T02:30:44.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.652+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f42dc0643a0 con 0x7f42bc060860 2024-08-17T02:30:44.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.652+0000 7f42d2ffd700 1 -- 172.21.15.155:0/1044468777 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f42dc0643a0 con 0x7f42bc060860 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 msgr2=0x7f42bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 0x7f42bc062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0093f0 tx=0x7f42cc016000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 msgr2=0x7f42dc151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f42c400cb70 tx=0x7f42c4001b50 comp rx=0 tx=0).stop 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 shutdown_connections 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f42bc060860 0x7f42bc062d10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42dc1571c0 0x7f42dc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0aedf0 0x7f42dc151010 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 --2- 172.21.15.155:0/1044468777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42dc067690 0x7f42dc169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 >> 172.21.15.155:0/1044468777 conn(0x7f42dc0ca2b0 msgr2=0x7f42dc0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 shutdown_connections 2024-08-17T02:30:44.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.656+0000 7f42db59e700 1 -- 172.21.15.155:0/1044468777 wait complete. 2024-08-17T02:30:44.661 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:30:44.670 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:30:44.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:44.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 Processor -- start 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 -- start start 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f468806bf00 0x7f46880af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4688156100 0x7f46880686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880afa10 con 0x7f4688155d30 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468815a1d0 con 0x7f468806bf00 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468d7b5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880ac7b0 con 0x7f4688156100 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f46877fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f468806bf00 0x7f46880af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f46877fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f468806bf00 0x7f46880af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42508/0 (socket says 172.21.15.155:42508) 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f46877fe700 1 -- 172.21.15.155:0/3941566372 learned_addr learned my addr 172.21.15.155:0/3941566372 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.780+0000 7f468cfb4700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4688156100 0x7f46880686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f46877fe700 1 -- 172.21.15.155:0/3941566372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4688156100 msgr2=0x7f46880686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f46877fe700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4688156100 0x7f46880686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f46877fe700 1 -- 172.21.15.155:0/3941566372 >> v1:172.21.15.189:6789/0 conn(0x7f4688155d30 legacy=0x7f4688159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f46877fe700 1 -- 172.21.15.155:0/3941566372 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880ac480 con 0x7f468806bf00 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f46877fe700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f468806bf00 0x7f46880af4d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f467000bc50 tx=0x7f467000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd74d0ce2aa128c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f4686ffd700 1 -- 172.21.15.155:0/3941566372 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000dbf0 con 0x7f468806bf00 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f4686ffd700 1 -- 172.21.15.155:0/3941566372 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000dd50 con 0x7f468806bf00 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f4686ffd700 1 -- 172.21.15.155:0/3941566372 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700196b0 con 0x7f468806bf00 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- 172.21.15.155:0/3941566372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f468806bf00 msgr2=0x7f46880af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f468806bf00 0x7f46880af4d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f467000bc50 tx=0x7f467000b4f0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- 172.21.15.155:0/3941566372 shutdown_connections 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4688156100 0x7f46880686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3941566372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f468806bf00 0x7f46880af4d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- 172.21.15.155:0/3941566372 >> 172.21.15.155:0/3941566372 conn(0x7f46880ccfd0 msgr2=0x7f468806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- 172.21.15.155:0/3941566372 shutdown_connections 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- 172.21.15.155:0/3941566372 wait complete. 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 Processor -- start 2024-08-17T02:30:44.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.784+0000 7f468d7b5700 1 -- start start 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f468806bf00 0x7f4688153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 0x7f46880c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4688156100 0x7f46880c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688156d90 con 0x7f4688155d30 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688157070 con 0x7f4688156100 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4688157350 con 0x7f468806bf00 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 0x7f46880c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 0x7f46880c1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42510/0 (socket says 172.21.15.155:42510) 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 -- 172.21.15.155:0/3008419141 learned_addr learned my addr 172.21.15.155:0/3008419141 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468cfb4700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4688156100 0x7f46880c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f4687fff700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f468806bf00 0x7f4688153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 -- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f468806bf00 msgr2=0x7f4688153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f468806bf00 0x7f4688153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 -- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4688156100 msgr2=0x7f46880c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4688156100 0x7f46880c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467000b790 con 0x7f4688155d30 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f46877fe700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 0x7f46880c1450 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f46880693e0 tx=0x7f467001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670010680 con 0x7f4688155d30 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700107e0 con 0x7f4688155d30 2024-08-17T02:30:44.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688157630 con 0x7f4688155d30 2024-08-17T02:30:44.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670010b60 con 0x7f4688155d30 2024-08-17T02:30:44.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.788+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46881541a0 con 0x7f4688155d30 2024-08-17T02:30:44.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4688154390 con 0x7f4688155d30 2024-08-17T02:30:44.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f467002c430 con 0x7f4688155d30 2024-08-17T02:30:44.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f46680608e0 0x7f4668062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4670014070 con 0x7f4688155d30 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f4687fff700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f46680608e0 0x7f4668062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f46680667d0 0x7f4668068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4668069290 con 0x7f46680667d0 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4670080b00 con 0x7f4688155d30 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f468cfb4700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f46680667d0 0x7f4668068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f4687fff700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f46680608e0 0x7f4668062d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f46880b1790 tx=0x7f4678009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.792+0000 7f468cfb4700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f46680667d0 0x7f4668068be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.796+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== osd.4 v2:172.21.15.189:6808/24445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4668069290 con 0x7f46680667d0 2024-08-17T02:30:44.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.812+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 --> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46880aa3b0 con 0x7f46680667d0 2024-08-17T02:30:44.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.812+0000 7f467ffff700 1 -- 172.21.15.155:0/3008419141 <== osd.4 v2:172.21.15.189:6808/24445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f46880aa3b0 con 0x7f46680667d0 2024-08-17T02:30:44.817 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:44.817 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:44.818 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:44.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f46680667d0 msgr2=0x7f4668068be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.189:6808/24445,v1:172.21.15.189:6809/24445] conn(0x7f46680667d0 0x7f4668068be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f46680608e0 msgr2=0x7f4668062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f46680608e0 0x7f4668062d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f46880b1790 tx=0x7f4678009040 comp rx=0 tx=0).stop 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 msgr2=0x7f46880c1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 --2- 172.21.15.155:0/3008419141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4688155d30 0x7f46880c1450 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f46880693e0 tx=0x7f467001b000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468cfb4700 1 -- 172.21.15.155:0/3008419141 reap_dead start 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 shutdown_connections 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 >> 172.21.15.155:0/3008419141 conn(0x7f46880ccfd0 msgr2=0x7f46880cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 shutdown_connections 2024-08-17T02:30:44.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.816+0000 7f468d7b5700 1 -- 172.21.15.155:0/3008419141 wait complete. 2024-08-17T02:30:44.829 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:30:44.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 Processor -- start 2024-08-17T02:30:44.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 -- start start 2024-08-17T02:30:44.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7f10155720 0x7f7f100b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100aba70 con 0x7f7f1006e9d0 2024-08-17T02:30:44.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100abd50 con 0x7f7f10155720 2024-08-17T02:30:44.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0ffff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100ac030 con 0x7f7f100ab540 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0effd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7f1006e9d0 0x7f7f10155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44062/0 (socket says 172.21.15.155:44062) 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0effd700 1 -- 172.21.15.155:0/18365568 learned_addr learned my addr 172.21.15.155:0/18365568 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0e7fc700 1 --2- 172.21.15.155:0/18365568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0f7fe700 1 --2- 172.21.15.155:0/18365568 >> v2:172.21.15.189:3300/0 conn(0x7f7f10155720 0x7f7f100b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0dffb700 1 -- 172.21.15.155:0/18365568 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93865306 0 0) 0x7f7f100aba70 con 0x7f7f1006e9d0 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0dffb700 1 -- 172.21.15.155:0/18365568 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef8003570 con 0x7f7f1006e9d0 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0e7fc700 1 -- 172.21.15.155:0/18365568 >> v2:172.21.15.189:3300/0 conn(0x7f7f10155720 msgr2=0x7f7f100b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0e7fc700 1 --2- 172.21.15.155:0/18365568 >> v2:172.21.15.189:3300/0 conn(0x7f7f10155720 0x7f7f100b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0e7fc700 1 -- 172.21.15.155:0/18365568 >> v1:172.21.15.155:6789/0 conn(0x7f7f1006e9d0 legacy=0x7f7f10155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.940+0000 7f7f0e7fc700 1 -- 172.21.15.155:0/18365568 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100ac310 con 0x7f7f100ab540 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0e7fc700 1 --2- 172.21.15.155:0/18365568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1006eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098e0 tx=0x7f7f000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5918098b0dd6452a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0dffb700 1 -- 172.21.15.155:0/18365568 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011630 con 0x7f7f100ab540 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0dffb700 1 -- 172.21.15.155:0/18365568 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00011790 con 0x7f7f100ab540 2024-08-17T02:30:44.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0dffb700 1 -- 172.21.15.155:0/18365568 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011b10 con 0x7f7f100ab540 2024-08-17T02:30:44.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- 172.21.15.155:0/18365568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 msgr2=0x7f7f1006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/18365568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1006eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098e0 tx=0x7f7f000091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- 172.21.15.155:0/18365568 shutdown_connections 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/18365568 >> v2:172.21.15.189:3300/0 conn(0x7f7f10155720 0x7f7f100b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/18365568 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1006eda0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- 172.21.15.155:0/18365568 >> 172.21.15.155:0/18365568 conn(0x7f7f100678d0 msgr2=0x7f7f10067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- 172.21.15.155:0/18365568 shutdown_connections 2024-08-17T02:30:44.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- 172.21.15.155:0/18365568 wait complete. 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 Processor -- start 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- start start 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1006e9d0 0x7f7f10152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1013d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10151ea0 con 0x7f7f10155720 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10150780 con 0x7f7f1006e9d0 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.944+0000 7f7f0ffff700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10151570 con 0x7f7f100ab540 2024-08-17T02:30:44.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42518/0 (socket says 172.21.15.155:42518) 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 -- 172.21.15.155:0/2368815355 learned_addr learned my addr 172.21.15.155:0/2368815355 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0effd700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1006e9d0 0x7f7f10152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0e7fc700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1013d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 -- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 msgr2=0x7f7f1013d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1013d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 -- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1006e9d0 msgr2=0x7f7f10152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1006e9d0 0x7f7f10152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 -- 172.21.15.155:0/2368815355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009420 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0f7fe700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009df0 tx=0x7f7f0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800cb50 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800f040 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08014480 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10151850 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1014a910 con 0x7f7f10155720 2024-08-17T02:30:44.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f100643a0 con 0x7f7f10155720 2024-08-17T02:30:44.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7f08014830 con 0x7f7f10155720 2024-08-17T02:30:44.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 0x7f7efc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7f0807da30 con 0x7f7f10155720 2024-08-17T02:30:44.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.948+0000 7f7f0effd700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 0x7f7efc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.952+0000 7f7f0effd700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 0x7f7efc062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f040058d0 tx=0x7f7f04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:44.960+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7f0804e120 con 0x7f7f10155720 2024-08-17T02:30:45.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.120+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f1006f5f0 con 0x7f7efc060860 2024-08-17T02:30:45.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.120+0000 7f7ef6ffd700 1 -- 172.21.15.155:0/2368815355 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f1006f5f0 con 0x7f7efc060860 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 msgr2=0x7f7efc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 0x7f7efc062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f040058d0 tx=0x7f7f04009040 comp rx=0 tx=0).stop 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 msgr2=0x7f7f1014fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009df0 tx=0x7f7f0800b040 comp rx=0 tx=0).stop 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 shutdown_connections 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f7efc060860 0x7f7efc062d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f10155720 0x7f7f1014fd30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7f100ab540 0x7f7f1013d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 --2- 172.21.15.155:0/2368815355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f1006e9d0 0x7f7f10152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 >> 172.21.15.155:0/2368815355 conn(0x7f7f100678d0 msgr2=0x7f7f100aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 shutdown_connections 2024-08-17T02:30:45.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.124+0000 7f7f0ffff700 1 -- 172.21.15.155:0/2368815355 wait complete. 2024-08-17T02:30:45.128 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:30:45.138 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:30:45.138 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:45.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.248+0000 7efc4359e700 1 Processor -- start 2024-08-17T02:30:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.248+0000 7efc4359e700 1 -- start start 2024-08-17T02:30:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 0x7efc440b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4359e700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 0x7efc440ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440c5b40 con 0x7efc440c5fd0 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4359e700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440b2aa0 con 0x7efc440cded0 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc44159820 con 0x7efc440b26d0 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc41d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efc440c5fd0 0x7efc440c6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44074/0 (socket says 172.21.15.155:44074) 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc41d9b700 1 -- 172.21.15.155:0/1179115422 learned_addr learned my addr 172.21.15.155:0/1179115422 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc42d9d700 1 --2- 172.21.15.155:0/1179115422 >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 0x7efc440ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 --2- 172.21.15.155:0/1179115422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 0x7efc440b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4159a700 1 -- 172.21.15.155:0/1179115422 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037002206 0 0) 0x7efc440c5b40 con 0x7efc440c5fd0 2024-08-17T02:30:45.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4159a700 1 -- 172.21.15.155:0/1179115422 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc2c003570 con 0x7efc440c5fd0 2024-08-17T02:30:45.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 -- 172.21.15.155:0/1179115422 >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 msgr2=0x7efc440ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 --2- 172.21.15.155:0/1179115422 >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 0x7efc440ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 -- 172.21.15.155:0/1179115422 >> v1:172.21.15.155:6789/0 conn(0x7efc440c5fd0 legacy=0x7efc440c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 -- 172.21.15.155:0/1179115422 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440c4f30 con 0x7efc440b26d0 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc42d9d700 1 --2- 172.21.15.155:0/1179115422 >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 0x7efc440ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4259c700 1 --2- 172.21.15.155:0/1179115422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 0x7efc440b2e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc380098e0 tx=0x7efc380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e35900fa4343544 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4159a700 1 -- 172.21.15.155:0/1179115422 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011630 con 0x7efc440b26d0 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4159a700 1 -- 172.21.15.155:0/1179115422 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38011790 con 0x7efc440b26d0 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.252+0000 7efc4159a700 1 -- 172.21.15.155:0/1179115422 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011b10 con 0x7efc440b26d0 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- 172.21.15.155:0/1179115422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 msgr2=0x7efc440b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- 172.21.15.155:0/1179115422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 0x7efc440b2e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc380098e0 tx=0x7efc380091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- 172.21.15.155:0/1179115422 shutdown_connections 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- 172.21.15.155:0/1179115422 >> v2:172.21.15.189:3300/0 conn(0x7efc440cded0 0x7efc440ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- 172.21.15.155:0/1179115422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc440b26d0 0x7efc440b2e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- 172.21.15.155:0/1179115422 >> 172.21.15.155:0/1179115422 conn(0x7efc44067590 msgr2=0x7efc440d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- 172.21.15.155:0/1179115422 shutdown_connections 2024-08-17T02:30:45.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- 172.21.15.155:0/1179115422 wait complete. 2024-08-17T02:30:45.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 Processor -- start 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- start start 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 0x7efc440ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc440cded0 0x7efc4415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc44157060 0x7efc440c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c85b0 con 0x7efc440c5fd0 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c79a0 con 0x7efc440cded0 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4359e700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c7c80 con 0x7efc44157060 2024-08-17T02:30:45.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 0x7efc440ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 0x7efc440ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42528/0 (socket says 172.21.15.155:42528) 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc4259c700 1 -- 172.21.15.155:0/373917636 learned_addr learned my addr 172.21.15.155:0/373917636 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc41d9b700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc440cded0 0x7efc4415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.256+0000 7efc42d9d700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc44157060 0x7efc440c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 -- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc44157060 msgr2=0x7efc440c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc44157060 0x7efc440c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 -- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc440cded0 msgr2=0x7efc4415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc440cded0 0x7efc4415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009a20 con 0x7efc440c5fd0 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc41d9b700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc440cded0 0x7efc4415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc42d9d700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efc44157060 0x7efc440c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4259c700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 0x7efc440ca0f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc38013000 tx=0x7efc38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011900 con 0x7efc440c5fd0 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38011ac0 con 0x7efc440c5fd0 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc38009420 con 0x7efc440c5fd0 2024-08-17T02:30:45.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3801a680 con 0x7efc440c5fd0 2024-08-17T02:30:45.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440c8240 con 0x7efc440c5fd0 2024-08-17T02:30:45.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc440644b0 con 0x7efc440c5fd0 2024-08-17T02:30:45.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efc3801aa30 con 0x7efc440c5fd0 2024-08-17T02:30:45.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efc24060860 0x7efc24062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.260+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efc3807e5a0 con 0x7efc440c5fd0 2024-08-17T02:30:45.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc41d9b700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efc24060860 0x7efc24062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc327fc700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7efc24066750 0x7efc24068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc24069210 con 0x7efc24066750 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc38080be0 con 0x7efc440c5fd0 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc42d9d700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7efc24066750 0x7efc24068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc41d9b700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efc24060860 0x7efc24062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc440c9870 tx=0x7efc34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc42d9d700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7efc24066750 0x7efc24068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.264+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== osd.5 v2:172.21.15.189:6800/24444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efc24069210 con 0x7efc24066750 2024-08-17T02:30:45.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 --> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc440ca630 con 0x7efc24066750 2024-08-17T02:30:45.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc327fc700 1 -- 172.21.15.155:0/373917636 <== osd.5 v2:172.21.15.189:6800/24444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc440ca630 con 0x7efc24066750 2024-08-17T02:30:45.288 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:45.288 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:45.288 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7efc24066750 msgr2=0x7efc24068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.189:6800/24444,v1:172.21.15.189:6801/24444] conn(0x7efc24066750 0x7efc24068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efc24060860 msgr2=0x7efc24062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7efc24060860 0x7efc24062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc440c9870 tx=0x7efc34009040 comp rx=0 tx=0).stop 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 msgr2=0x7efc440ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 --2- 172.21.15.155:0/373917636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc440c5fd0 0x7efc440ca0f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc38013000 tx=0x7efc38017000 comp rx=0 tx=0).stop 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc42d9d700 1 -- 172.21.15.155:0/373917636 reap_dead start 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 shutdown_connections 2024-08-17T02:30:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 >> 172.21.15.155:0/373917636 conn(0x7efc44067590 msgr2=0x7efc44068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 shutdown_connections 2024-08-17T02:30:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.284+0000 7efc4359e700 1 -- 172.21.15.155:0/373917636 wait complete. 2024-08-17T02:30:45.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:30:45.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 Processor -- start 2024-08-17T02:30:45.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 -- start start 2024-08-17T02:30:45.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b300b0d20 0x7f0b3006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b3006e450 0x7f0b300b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0b300b1630 0x7f0b301610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b30141a00 con 0x7f0b300b0d20 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3006e8a0 con 0x7f0b300b1630 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b34c9f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30140b10 con 0x7f0b3006e450 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.412+0000 7f0b2f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b300b0d20 0x7f0b3006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b300b0d20 0x7f0b3006df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42538/0 (socket says 172.21.15.155:42538) 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1183680171 learned_addr learned my addr 172.21.15.155:0/1183680171 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b27fff700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b3006e450 0x7f0b300b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2ffff700 1 --2- 172.21.15.155:0/1183680171 >> v2:172.21.15.189:3300/0 conn(0x7f0b300b1630 0x7f0b301610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1183680171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b3006e450 msgr2=0x7f0b300b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b3006e450 0x7f0b300b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1183680171 >> v2:172.21.15.189:3300/0 conn(0x7f0b300b1630 msgr2=0x7f0b301610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1183680171 >> v2:172.21.15.189:3300/0 conn(0x7f0b300b1630 0x7f0b301610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1183680171 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30140df0 con 0x7f0b300b0d20 2024-08-17T02:30:45.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300b0d20 0x7f0b3006df10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b30070d30 tx=0x7f0b18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07e392d1bc256d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2effd700 1 -- 172.21.15.155:0/1183680171 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800b640 con 0x7f0b300b0d20 2024-08-17T02:30:45.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2effd700 1 -- 172.21.15.155:0/1183680171 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800b7a0 con 0x7f0b300b0d20 2024-08-17T02:30:45.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b2effd700 1 -- 172.21.15.155:0/1183680171 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800bb60 con 0x7f0b300b0d20 2024-08-17T02:30:45.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1183680171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300b0d20 msgr2=0x7f0b3006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300b0d20 0x7f0b3006df10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b30070d30 tx=0x7f0b18009250 comp rx=0 tx=0).stop 2024-08-17T02:30:45.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1183680171 shutdown_connections 2024-08-17T02:30:45.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1183680171 >> v2:172.21.15.189:3300/0 conn(0x7f0b300b1630 0x7f0b301610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b3006e450 0x7f0b300b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1183680171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300b0d20 0x7f0b3006df10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1183680171 >> 172.21.15.155:0/1183680171 conn(0x7f0b300678d0 msgr2=0x7f0b30067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1183680171 shutdown_connections 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.416+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1183680171 wait complete. 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 Processor -- start 2024-08-17T02:30:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- start start 2024-08-17T02:30:45.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 0x7f0b3016e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b300b1630 0x7f0b30170a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30145ba0 con 0x7f0b3006e450 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3016eb20 con 0x7f0b300b1630 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30170f40 con 0x7f0b300b0d20 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42546/0 (socket says 172.21.15.155:42546) 2024-08-17T02:30:45.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1444544573 learned_addr learned my addr 172.21.15.155:0/1444544573 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b27fff700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 0x7f0b3016e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2ffff700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b300b1630 0x7f0b30170a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 msgr2=0x7f0b3016e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 0x7f0b3016e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b300b1630 msgr2=0x7f0b30170a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b300b1630 0x7f0b30170a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 -- 172.21.15.155:0/1444544573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180094f0 con 0x7f0b3006e450 2024-08-17T02:30:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b27fff700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 0x7f0b3016e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b2f7fe700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0b3006c2d0 tx=0x7f0b18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800b910 con 0x7f0b3006e450 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800ba70 con 0x7f0b3006e450 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b30145300 con 0x7f0b3006e450 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18026680 con 0x7f0b3006e450 2024-08-17T02:30:45.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.420+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b301458c0 con 0x7f0b3006e450 2024-08-17T02:30:45.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30143010 con 0x7f0b3006e450 2024-08-17T02:30:45.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0b18023030 con 0x7f0b3006e450 2024-08-17T02:30:45.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b277fe700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 0x7f0b10062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b27fff700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 0x7f0b10062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0b1807e050 con 0x7f0b3006e450 2024-08-17T02:30:45.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.424+0000 7f0b27fff700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 0x7f0b10062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b3006de90 tx=0x7f0b20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.432+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0b30143010 con 0x7f0b3006e450 2024-08-17T02:30:45.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.600+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b300643a0 con 0x7f0b10060860 2024-08-17T02:30:45.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.600+0000 7f0b277fe700 1 -- 172.21.15.155:0/1444544573 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b300643a0 con 0x7f0b10060860 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 msgr2=0x7f0b10062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 0x7f0b10062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b3006de90 tx=0x7f0b20008040 comp rx=0 tx=0).stop 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 msgr2=0x7f0b30144c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0b3006c2d0 tx=0x7f0b18017000 comp rx=0 tx=0).stop 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 shutdown_connections 2024-08-17T02:30:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f0b10060860 0x7f0b10062d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b300b1630 0x7f0b30170a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0b300b0d20 0x7f0b3016e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 --2- 172.21.15.155:0/1444544573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b3006e450 0x7f0b30144c70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 >> 172.21.15.155:0/1444544573 conn(0x7f0b300678d0 msgr2=0x7f0b3015ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 shutdown_connections 2024-08-17T02:30:45.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.604+0000 7f0b34c9f700 1 -- 172.21.15.155:0/1444544573 wait complete. 2024-08-17T02:30:45.609 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:30:45.618 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:30:45.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:45.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.728+0000 7f37a0a94700 1 Processor -- start 2024-08-17T02:30:45.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.728+0000 7f37a0a94700 1 -- start start 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f37a0a94700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f379c0cbb70 0x7f379c0b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f37a0a94700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0b1680 con 0x7f379c0cbf40 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f37a0a94700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0b0710 con 0x7f379c068db0 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f37a0a94700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0afb00 con 0x7f379c0cbb70 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f379c0cbb70 0x7f379c0b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379affd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f379c0cbf40 0x7f379c0686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44088/0 (socket says 172.21.15.155:44088) 2024-08-17T02:30:45.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379affd700 1 -- 172.21.15.155:0/169506151 learned_addr learned my addr 172.21.15.155:0/169506151 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379b7fe700 1 -- 172.21.15.155:0/169506151 >> v1:172.21.15.189:6789/0 conn(0x7f379c068db0 legacy=0x7f379c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379b7fe700 1 -- 172.21.15.155:0/169506151 >> v1:172.21.15.155:6789/0 conn(0x7f379c0cbf40 legacy=0x7f379c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379a7fc700 1 -- 172.21.15.155:0/169506151 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384288754 0 0) 0x7f3790001110 con 0x7f379c0cbf40 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379b7fe700 1 -- 172.21.15.155:0/169506151 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0afde0 con 0x7f379c0cbb70 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379b7fe700 1 --2- 172.21.15.155:0/169506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c0b1140 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f378c0098e0 tx=0x7f378c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0e210aad00a92f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379a7fc700 1 -- 172.21.15.155:0/169506151 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c009e80 con 0x7f379c0cbb70 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379a7fc700 1 -- 172.21.15.155:0/169506151 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00b8f0 con 0x7f379c0cbb70 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.732+0000 7f379a7fc700 1 -- 172.21.15.155:0/169506151 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00bc70 con 0x7f379c0cbb70 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/169506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 msgr2=0x7f379c0b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 --2- 172.21.15.155:0/169506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c0b1140 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f378c0098e0 tx=0x7f378c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/169506151 shutdown_connections 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 --2- 172.21.15.155:0/169506151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c0b1140 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/169506151 >> 172.21.15.155:0/169506151 conn(0x7f379c0ccfe0 msgr2=0x7f379c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/169506151 shutdown_connections 2024-08-17T02:30:45.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/169506151 wait complete. 2024-08-17T02:30:45.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 Processor -- start 2024-08-17T02:30:45.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- start start 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f379c068db0 0x7f379c143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f379c0cbf40 0x7f379c069e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c143560 con 0x7f379c0cbb70 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0a54f0 con 0x7f379c068db0 2024-08-17T02:30:45.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0a57d0 con 0x7f379c0cbf40 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42556/0 (socket says 172.21.15.155:42556) 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 -- 172.21.15.155:0/2233269306 learned_addr learned my addr 172.21.15.155:0/2233269306 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379b7fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f379c068db0 0x7f379c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379bfff700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f379c0cbf40 0x7f379c069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 -- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f379c0cbf40 msgr2=0x7f379c069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f379c0cbf40 0x7f379c069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 -- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f379c068db0 msgr2=0x7f379c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f379c068db0 0x7f379c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c009420 con 0x7f379c0cbb70 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379b7fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f379c068db0 0x7f379c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f379affd700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c153a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f379000c810 tx=0x7f3790007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790005b30 con 0x7f379c0cbb70 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790005cb0 con 0x7f379c0cbb70 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0a5ab0 con 0x7f379c0cbb70 2024-08-17T02:30:45.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790007340 con 0x7f379c0cbb70 2024-08-17T02:30:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.736+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c0a6070 con 0x7f379c0cbb70 2024-08-17T02:30:45.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f379c0644b0 con 0x7f379c0cbb70 2024-08-17T02:30:45.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3790025430 con 0x7f379c0cbb70 2024-08-17T02:30:45.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3788060860 0x7f3788062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f379b7fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3788060860 0x7f3788062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f379007cd50 con 0x7f379c0cbb70 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7f3788066750 0x7f3788068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3788069210 con 0x7f3788066750 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f379007d120 con 0x7f379c0cbb70 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f379b7fe700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3788060860 0x7f3788062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f378c0093f0 tx=0x7f378c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.740+0000 7f379bfff700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7f3788066750 0x7f3788068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.744+0000 7f379bfff700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7f3788066750 0x7f3788068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.744+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== osd.6 v2:172.21.15.189:6824/24446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3788069210 con 0x7f3788066750 2024-08-17T02:30:45.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.760+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 --> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f379c0b1680 con 0x7f3788066750 2024-08-17T02:30:45.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37837fe700 1 -- 172.21.15.155:0/2233269306 <== osd.6 v2:172.21.15.189:6824/24446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f379c0b1680 con 0x7f3788066750 2024-08-17T02:30:45.766 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:45.766 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:45.767 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:45.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7f3788066750 msgr2=0x7f3788068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.189:6824/24446,v1:172.21.15.189:6825/24446] conn(0x7f3788066750 0x7f3788068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3788060860 msgr2=0x7f3788062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f3788060860 0x7f3788062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f378c0093f0 tx=0x7f378c017000 comp rx=0 tx=0).stop 2024-08-17T02:30:45.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 msgr2=0x7f379c153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 --2- 172.21.15.155:0/2233269306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f379c0cbb70 0x7f379c153a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f379000c810 tx=0x7f3790007c10 comp rx=0 tx=0).stop 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f379bfff700 1 -- 172.21.15.155:0/2233269306 reap_dead start 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 shutdown_connections 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 >> 172.21.15.155:0/2233269306 conn(0x7f379c0ccfe0 msgr2=0x7f379c157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 shutdown_connections 2024-08-17T02:30:45.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.764+0000 7f37a0a94700 1 -- 172.21.15.155:0/2233269306 wait complete. 2024-08-17T02:30:45.779 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:30:45.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.884+0000 7f269d7e0700 1 Processor -- start 2024-08-17T02:30:45.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.884+0000 7f269d7e0700 1 -- start start 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f26980cd1b0 0x7f26981536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269815a610 con 0x7f2698153320 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269815dbd0 con 0x7f269815a190 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980ce430 con 0x7f26980cd1b0 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2697fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2698153320 0x7f26980ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44100/0 (socket says 172.21.15.155:44100) 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2697fff700 1 -- 172.21.15.155:0/3501163918 learned_addr learned my addr 172.21.15.155:0/3501163918 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f26977fe700 1 --2- 172.21.15.155:0/3501163918 >> v2:172.21.15.189:3300/0 conn(0x7f26980cd1b0 0x7f26981536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2696ffd700 1 -- 172.21.15.155:0/3501163918 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400265559 0 0) 0x7f269815a610 con 0x7f2698153320 2024-08-17T02:30:45.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2696ffd700 1 -- 172.21.15.155:0/3501163918 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2684003570 con 0x7f2698153320 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f26977fe700 1 -- 172.21.15.155:0/3501163918 >> v1:172.21.15.189:6789/0 conn(0x7f269815a190 legacy=0x7f26980ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f26977fe700 1 -- 172.21.15.155:0/3501163918 >> v1:172.21.15.155:6789/0 conn(0x7f2698153320 legacy=0x7f26980ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f26977fe700 1 -- 172.21.15.155:0/3501163918 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269815d370 con 0x7f26980cd1b0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f26977fe700 1 --2- 172.21.15.155:0/3501163918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26980cd1b0 0x7f26981536f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2680009910 tx=0x7f26800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd864bac81c410d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2696ffd700 1 -- 172.21.15.155:0/3501163918 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268000b640 con 0x7f26980cd1b0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2696ffd700 1 -- 172.21.15.155:0/3501163918 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268000b7a0 con 0x7f26980cd1b0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f2696ffd700 1 -- 172.21.15.155:0/3501163918 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268000bb60 con 0x7f26980cd1b0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- 172.21.15.155:0/3501163918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26980cd1b0 msgr2=0x7f26981536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 --2- 172.21.15.155:0/3501163918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26980cd1b0 0x7f26981536f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2680009910 tx=0x7f26800091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- 172.21.15.155:0/3501163918 shutdown_connections 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 --2- 172.21.15.155:0/3501163918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26980cd1b0 0x7f26981536f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- 172.21.15.155:0/3501163918 >> 172.21.15.155:0/3501163918 conn(0x7f26980d00a0 msgr2=0x7f26980d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- 172.21.15.155:0/3501163918 shutdown_connections 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.888+0000 7f269d7e0700 1 -- 172.21.15.155:0/3501163918 wait complete. 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 Processor -- start 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 -- start start 2024-08-17T02:30:45.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2698153320 0x7f2698152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f269815a190 0x7f269814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269816a1e0 con 0x7f26980cd1b0 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269816a890 con 0x7f2698153320 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269d7e0700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26980c9b40 con 0x7f269815a190 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f2697fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f2697fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42560/0 (socket says 172.21.15.155:42560) 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f2697fff700 1 -- 172.21.15.155:0/490334390 learned_addr learned my addr 172.21.15.155:0/490334390 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f26977fe700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2698153320 0x7f2698152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.892+0000 7f269cfdf700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f269815a190 0x7f269814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 -- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f269815a190 msgr2=0x7f269814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f269815a190 0x7f269814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 -- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2698153320 msgr2=0x7f2698152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2698153320 0x7f2698152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 -- 172.21.15.155:0/490334390 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680009420 con 0x7f26980cd1b0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f2697fff700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f268800c7f0 tx=0x7f2688007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688005cd0 con 0x7f26980cd1b0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688005e50 con 0x7f26980cd1b0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26980c9db0 con 0x7f26980cd1b0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688007320 con 0x7f26980cd1b0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26980ca370 con 0x7f26980cd1b0 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.896+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26980ca5c0 con 0x7f26980cd1b0 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.900+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f268801b3b0 con 0x7f26980cd1b0 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.900+0000 7f268ffff700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 0x7f2678062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.900+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f268807bf90 con 0x7f26980cd1b0 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.900+0000 7f26977fe700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 0x7f2678062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.900+0000 7f26977fe700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 0x7f2678062d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2680009910 tx=0x7f2680017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:45.908+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f268804c680 con 0x7f26980cd1b0 2024-08-17T02:30:46.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.072+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f26980638f0 con 0x7f2678060890 2024-08-17T02:30:46.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f268ffff700 1 -- 172.21.15.155:0/490334390 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f26980638f0 con 0x7f2678060890 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 msgr2=0x7f2678062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 0x7f2678062d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2680009910 tx=0x7f2680017000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 msgr2=0x7f269816a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f268800c7f0 tx=0x7f2688007e00 comp rx=0 tx=0).stop 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 shutdown_connections 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f2678060890 0x7f2678062d40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f269815a190 0x7f269814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2698153320 0x7f2698152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 --2- 172.21.15.155:0/490334390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26980cd1b0 0x7f269816a350 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 >> 172.21.15.155:0/490334390 conn(0x7f26980d00a0 msgr2=0x7f26980cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 shutdown_connections 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.076+0000 7f269d7e0700 1 -- 172.21.15.155:0/490334390 wait complete. 2024-08-17T02:30:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:30:46.092 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:30:46.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:46.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.204+0000 7f63de31a700 1 Processor -- start 2024-08-17T02:30:46.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.204+0000 7f63de31a700 1 -- start start 2024-08-17T02:30:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f63d80ce640 0x7f63d80b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63d80cea10 0x7f63d80cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d80c5bb0 con 0x7f63d80cc230 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d80c4fa0 con 0x7f63d80cea10 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d80c5280 con 0x7f63d80ce640 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63d80cea10 0x7f63d80cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63d80cea10 0x7f63d80cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42572/0 (socket says 172.21.15.155:42572) 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 -- 172.21.15.155:0/4202693107 learned_addr learned my addr 172.21.15.155:0/4202693107 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dd318700 1 --2- 172.21.15.155:0/4202693107 >> v2:172.21.15.189:3300/0 conn(0x7f63d80ce640 0x7f63d80b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 -- 172.21.15.155:0/4202693107 >> v2:172.21.15.189:3300/0 conn(0x7f63d80ce640 msgr2=0x7f63d80b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 --2- 172.21.15.155:0/4202693107 >> v2:172.21.15.189:3300/0 conn(0x7f63d80ce640 0x7f63d80b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 -- 172.21.15.155:0/4202693107 >> v1:172.21.15.189:6789/0 conn(0x7f63d80cc230 legacy=0x7f63d80c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 -- 172.21.15.155:0/4202693107 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80c5560 con 0x7f63d80cea10 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63dcb17700 1 --2- 172.21.15.155:0/4202693107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cea10 0x7f63d80cbcf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f63d80d0030 tx=0x7f63d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d950e4fd3693592e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63cbfff700 1 -- 172.21.15.155:0/4202693107 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400b860 con 0x7f63d80cea10 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63cbfff700 1 -- 172.21.15.155:0/4202693107 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d400b9c0 con 0x7f63d80cea10 2024-08-17T02:30:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63cbfff700 1 -- 172.21.15.155:0/4202693107 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400bd60 con 0x7f63d80cea10 2024-08-17T02:30:46.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- 172.21.15.155:0/4202693107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cea10 msgr2=0x7f63d80cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 --2- 172.21.15.155:0/4202693107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cea10 0x7f63d80cbcf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f63d80d0030 tx=0x7f63d4009250 comp rx=0 tx=0).stop 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- 172.21.15.155:0/4202693107 shutdown_connections 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 --2- 172.21.15.155:0/4202693107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cea10 0x7f63d80cbcf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 --2- 172.21.15.155:0/4202693107 >> v2:172.21.15.189:3300/0 conn(0x7f63d80ce640 0x7f63d80b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- 172.21.15.155:0/4202693107 >> 172.21.15.155:0/4202693107 conn(0x7f63d8099410 msgr2=0x7f63d80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- 172.21.15.155:0/4202693107 shutdown_connections 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.208+0000 7f63de31a700 1 -- 172.21.15.155:0/4202693107 wait complete. 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 Processor -- start 2024-08-17T02:30:46.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 -- start start 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 0x7f63d80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d80ce640 0x7f63d814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63d815e460 0x7f63d815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d814b2c0 con 0x7f63d80cc230 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c97b0 con 0x7f63d815e460 2024-08-17T02:30:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63de31a700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80c8e80 con 0x7f63d80ce640 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63dd318700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 0x7f63d80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.212+0000 7f63dd318700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 0x7f63d80c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42576/0 (socket says 172.21.15.155:42576) 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 -- 172.21.15.155:0/2007391027 learned_addr learned my addr 172.21.15.155:0/2007391027 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dcb17700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d80ce640 0x7f63d814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63ddb19700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63d815e460 0x7f63d815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 -- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d80ce640 msgr2=0x7f63d814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d80ce640 0x7f63d814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 -- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63d815e460 msgr2=0x7f63d815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63d815e460 0x7f63d815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40094f0 con 0x7f63d80cc230 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dcb17700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63d80ce640 0x7f63d814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63ddb19700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63d815e460 0x7f63d815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63dd318700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 0x7f63d80c9c40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00d860 tx=0x7f63cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0125f0 con 0x7f63d80cc230 2024-08-17T02:30:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc012750 con 0x7f63d80cc230 2024-08-17T02:30:46.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d80c9160 con 0x7f63d80cc230 2024-08-17T02:30:46.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc012b10 con 0x7f63d80cc230 2024-08-17T02:30:46.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80c8b50 con 0x7f63d80cc230 2024-08-17T02:30:46.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63d80644b0 con 0x7f63d80cc230 2024-08-17T02:30:46.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.216+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f63cc01e460 con 0x7f63d80cc230 2024-08-17T02:30:46.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f63bc060860 0x7f63bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f63cc07cfb0 con 0x7f63d80cc230 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63dcb17700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f63bc060860 0x7f63bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f63bc066750 0x7f63bc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63bc069210 con 0x7f63bc066750 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63cc07f590 con 0x7f63d80cc230 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63ddb19700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f63bc066750 0x7f63bc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63dcb17700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f63bc060860 0x7f63bc062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63d80d0030 tx=0x7f63d4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63ddb19700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f63bc066750 0x7f63bc068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.220+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== osd.7 v2:172.21.15.189:6810/24447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f63bc069210 con 0x7f63bc066750 2024-08-17T02:30:46.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 --> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f63d8070560 con 0x7f63bc066750 2024-08-17T02:30:46.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63c97fa700 1 -- 172.21.15.155:0/2007391027 <== osd.7 v2:172.21.15.189:6810/24447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f63d8070560 con 0x7f63bc066750 2024-08-17T02:30:46.241 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-08-17T02:30:46.241 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:46.241 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f63bc066750 msgr2=0x7f63bc068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.189:6810/24447,v1:172.21.15.189:6812/24447] conn(0x7f63bc066750 0x7f63bc068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f63bc060860 msgr2=0x7f63bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f63bc060860 0x7f63bc062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63d80d0030 tx=0x7f63d4017000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 msgr2=0x7f63d80c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63de31a700 1 --2- 172.21.15.155:0/2007391027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63d80cc230 0x7f63d80c9c40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00d860 tx=0x7f63cc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.236+0000 7f63ddb19700 1 -- 172.21.15.155:0/2007391027 reap_dead start 2024-08-17T02:30:46.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.240+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 shutdown_connections 2024-08-17T02:30:46.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.240+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 >> 172.21.15.155:0/2007391027 conn(0x7f63d8099410 msgr2=0x7f63d80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.240+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 shutdown_connections 2024-08-17T02:30:46.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.240+0000 7f63de31a700 1 -- 172.21.15.155:0/2007391027 wait complete. 2024-08-17T02:30:46.254 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:30:46.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.360+0000 7f41888f7700 1 Processor -- start 2024-08-17T02:30:46.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- start start 2024-08-17T02:30:46.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f418413f670 0x7f41840b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840ae8c0 con 0x7f418413fa40 2024-08-17T02:30:46.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418406f0e0 con 0x7f418413f670 2024-08-17T02:30:46.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840b1820 con 0x7f418406e720 2024-08-17T02:30:46.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f417bfff700 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f418413fa40 0x7f41840ade00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.155:56146/0 (socket says 172.21.15.155:56146) 2024-08-17T02:30:46.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f417bfff700 1 -- 172.21.15.155:0/1918747 learned_addr learned my addr 172.21.15.155:0/1918747 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:46.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f4182d9d700 1 --2- 172.21.15.155:0/1918747 >> v2:172.21.15.189:3300/0 conn(0x7f418413f670 0x7f41840b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 --2- 172.21.15.155:0/1918747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418259c700 1 -- 172.21.15.155:0/1918747 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503108860 0 0) 0x7f41840ae8c0 con 0x7f418413fa40 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418259c700 1 -- 172.21.15.155:0/1918747 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4170003570 con 0x7f418413fa40 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 -- 172.21.15.155:0/1918747 >> v2:172.21.15.189:3300/0 conn(0x7f418413f670 msgr2=0x7f41840b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 --2- 172.21.15.155:0/1918747 >> v2:172.21.15.189:3300/0 conn(0x7f418413f670 0x7f41840b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 -- 172.21.15.155:0/1918747 >> v1:172.21.15.189:6789/0 conn(0x7f418413fa40 legacy=0x7f41840ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 -- 172.21.15.155:0/1918747 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840ad710 con 0x7f418406e720 2024-08-17T02:30:46.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418359e700 1 --2- 172.21.15.155:0/1918747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418406eba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f417c009e60 tx=0x7f417c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96d010dc10ff7f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418259c700 1 -- 172.21.15.155:0/1918747 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00e070 con 0x7f418406e720 2024-08-17T02:30:46.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418259c700 1 -- 172.21.15.155:0/1918747 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00bab0 con 0x7f418406e720 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f418259c700 1 -- 172.21.15.155:0/1918747 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00be70 con 0x7f418406e720 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- 172.21.15.155:0/1918747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 msgr2=0x7f418406eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 --2- 172.21.15.155:0/1918747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418406eba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f417c009e60 tx=0x7f417c009780 comp rx=0 tx=0).stop 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- 172.21.15.155:0/1918747 shutdown_connections 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 --2- 172.21.15.155:0/1918747 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418406eba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 --2- 172.21.15.155:0/1918747 >> v2:172.21.15.189:3300/0 conn(0x7f418413f670 0x7f41840b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- 172.21.15.155:0/1918747 >> 172.21.15.155:0/1918747 conn(0x7f41840ca2b0 msgr2=0x7f418406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- 172.21.15.155:0/1918747 shutdown_connections 2024-08-17T02:30:46.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.364+0000 7f41888f7700 1 -- 172.21.15.155:0/1918747 wait complete. 2024-08-17T02:30:46.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 Processor -- start 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 -- start start 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418413dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f418413fa40 0x7f4184156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41841690a0 con 0x7f418413f670 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184069ed0 con 0x7f418413fa40 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f41888f7700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418413d340 con 0x7f418406e720 2024-08-17T02:30:46.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42588/0 (socket says 172.21.15.155:42588) 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 -- 172.21.15.155:0/4153094032 learned_addr learned my addr 172.21.15.155:0/4153094032 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f418359e700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f418413fa40 0x7f4184156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f4182d9d700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418413dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 -- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 msgr2=0x7f418413dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418413dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 -- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f418413fa40 msgr2=0x7f4184156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f418413fa40 0x7f4184156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 -- 172.21.15.155:0/4153094032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009a20 con 0x7f418413f670 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417bfff700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7c0 tx=0x7f416c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c005c00 con 0x7f418413f670 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.368+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c005d60 con 0x7f418413f670 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840692c0 con 0x7f418413f670 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c007320 con 0x7f418413f670 2024-08-17T02:30:46.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184069880 con 0x7f418413f670 2024-08-17T02:30:46.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840643a0 con 0x7f418413f670 2024-08-17T02:30:46.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f416c007690 con 0x7f418413f670 2024-08-17T02:30:46.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f417affd700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 0x7f4164062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f4182d9d700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 0x7f4164062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.372+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f416c07be30 con 0x7f418413f670 2024-08-17T02:30:46.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.376+0000 7f4182d9d700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 0x7f4164062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4174009db0 tx=0x7f41740091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.380+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f416c04c480 con 0x7f418413f670 2024-08-17T02:30:46.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.544+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4184134660 con 0x7f4164060860 2024-08-17T02:30:46.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.544+0000 7f417affd700 1 -- 172.21.15.155:0/4153094032 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4184134660 con 0x7f4164060860 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 msgr2=0x7f4164062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 0x7f4164062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4174009db0 tx=0x7f41740091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 msgr2=0x7f4184168b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7c0 tx=0x7f416c007dd0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 shutdown_connections 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f4164060860 0x7f4164062d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f418413fa40 0x7f4184156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f418413f670 0x7f4184168b60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 --2- 172.21.15.155:0/4153094032 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f418406e720 0x7f418413dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 >> 172.21.15.155:0/4153094032 conn(0x7f41840ca2b0 msgr2=0x7f41840633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 shutdown_connections 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.548+0000 7f41888f7700 1 -- 172.21.15.155:0/4153094032 wait complete. 2024-08-17T02:30:46.553 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:30:46.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.672+0000 7fb103306700 1 Processor -- start 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.672+0000 7fb103306700 1 -- start start 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc06e9d0 0x7fb0fc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0fc0ab540 0x7fb0fc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0aba70 con 0x7fb0fc155010 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0abd50 con 0x7fb0fc0ab540 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ac030 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb102b05700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb0fc155010 0x7fb0fc155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44112/0 (socket says 172.21.15.155:44112) 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb102b05700 1 -- 172.21.15.155:0/2477002373 learned_addr learned my addr 172.21.15.155:0/2477002373 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 --2- 172.21.15.155:0/2477002373 >> v2:172.21.15.189:3300/0 conn(0x7fb0fc0ab540 0x7fb0fc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb102304700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc06e9d0 0x7fb0fc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101302700 1 -- 172.21.15.155:0/2477002373 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902887215 0 0) 0x7fb0fc0aba70 con 0x7fb0fc155010 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101302700 1 -- 172.21.15.155:0/2477002373 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e0003570 con 0x7fb0fc155010 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 -- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc06e9d0 msgr2=0x7fb0fc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc06e9d0 0x7fb0fc06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 -- 172.21.15.155:0/2477002373 >> v1:172.21.15.155:6789/0 conn(0x7fb0fc155010 legacy=0x7fb0fc155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 -- 172.21.15.155:0/2477002373 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0ac310 con 0x7fb0fc0ab540 2024-08-17T02:30:46.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101b03700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc0b1320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009e60 tx=0x7fb0e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5448cd5d9e5b385 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101302700 1 -- 172.21.15.155:0/2477002373 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800e070 con 0x7fb0fc0ab540 2024-08-17T02:30:46.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101302700 1 -- 172.21.15.155:0/2477002373 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800bab0 con 0x7fb0fc0ab540 2024-08-17T02:30:46.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb101302700 1 -- 172.21.15.155:0/2477002373 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800be70 con 0x7fb0fc0ab540 2024-08-17T02:30:46.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 msgr2=0x7fb0fc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc0b1320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009e60 tx=0x7fb0e8009780 comp rx=0 tx=0).stop 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- 172.21.15.155:0/2477002373 shutdown_connections 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc0b1320 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 --2- 172.21.15.155:0/2477002373 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc06e9d0 0x7fb0fc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- 172.21.15.155:0/2477002373 >> 172.21.15.155:0/2477002373 conn(0x7fb0fc0678d0 msgr2=0x7fb0fc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- 172.21.15.155:0/2477002373 shutdown_connections 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.676+0000 7fb103306700 1 -- 172.21.15.155:0/2477002373 wait complete. 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 Processor -- start 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- start start 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc155010 0x7fb0fc1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ca880 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc152530 con 0x7fb0fc0ab540 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc152810 con 0x7fb0fc155010 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42590/0 (socket says 172.21.15.155:42590) 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 -- 172.21.15.155:0/1706062036 learned_addr learned my addr 172.21.15.155:0/1706062036 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb101b03700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102b05700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc155010 0x7fb0fc1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 -- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc155010 msgr2=0x7fb0fc1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc155010 0x7fb0fc1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 -- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 msgr2=0x7fb0fc158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 -- 172.21.15.155:0/1706062036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009a20 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb102304700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400ec80 tx=0x7fb0f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400c850 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400c9b0 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc152af0 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400cd50 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.680+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc1517b0 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc0643a0 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0f4013680 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb0fa7fc700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 0x7fb0e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb0f407cbd0 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb101b03700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 0x7fb0e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.684+0000 7fb101b03700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 0x7fb0e4062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80097c0 tx=0x7fb0e8019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.688+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb0f404d220 con 0x7fb0fc06e9d0 2024-08-17T02:30:46.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.852+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0fc152f70 con 0x7fb0e4060860 2024-08-17T02:30:46.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.856+0000 7fb0fa7fc700 1 -- 172.21.15.155:0/1706062036 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48738 (secure 0 0 0) 0x7fb0e800be20 con 0x7fb0e4060860 2024-08-17T02:30:46.861 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:30:46.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 msgr2=0x7fb0e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 0x7fb0e4062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80097c0 tx=0x7fb0e8019000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 msgr2=0x7fb0fc0ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400ec80 tx=0x7fb0f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 shutdown_connections 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fb0e4060860 0x7fb0e4062d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0fc155010 0x7fb0fc1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0fc0ab540 0x7fb0fc158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 --2- 172.21.15.155:0/1706062036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0fc06e9d0 0x7fb0fc0ca340 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 >> 172.21.15.155:0/1706062036 conn(0x7fb0fc0678d0 msgr2=0x7fb0fc155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 shutdown_connections 2024-08-17T02:30:46.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:30:46.860+0000 7fb103306700 1 -- 172.21.15.155:0/1706062036 wait complete. 2024-08-17T02:30:46.865 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:30:46.875 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:30:46.013292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396572,"kb_used_data":5220,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578148,"statfs":{"total":773094113280,"available":770640023552,"internally_reserved":0,"allocated":5345280,"data_stored":2927213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.534172"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:30:38.664845+0000","last_change":"2024-08-17T02:27:17.682083+0000","last_active":"2024-08-17T02:30:38.664845+0000","last_peered":"2024-08-17T02:30:38.664845+0000","last_clean":"2024-08-17T02:30:38.664845+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:30:38.664845+0000","last_undegraded":"2024-08-17T02:30:38.664845+0000","last_fullsized":"2024-08-17T02:30:38.664845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:16.664091+0000","last_clean_scrub_stamp":"2024-08-17T02:27:16.664091+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.177,"5min":1.306,"15min":1.306},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.84099999999999997,"15min":0.81699999999999995},"min":{"1min":0.65700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.627}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88900000000000001,"15min":0.85699999999999998},"min":{"1min":0.63800000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.446,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.74399999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.335,"5min":1.637,"15min":1.637},"last":1.0149999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88900000000000001,"15min":0.86899999999999999},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.224,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.88100000000000001,"15min":0.87},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.98999999999999999,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92900000000000005,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.80200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89400000000000002,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.27,"5min":1.276,"15min":1.276},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1839999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4810000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.2310000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.397,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.171,"15min":1.157},"min":{"1min":0.88200000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.417,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.266}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.88400000000000001,"15min":0.83499999999999996},"min":{"1min":0.64000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.997,"5min":0.97499999999999998,"15min":0.96299999999999997},"min":{"1min":0.79000000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.206,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.63,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88800000000000001},"min":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2090000000000001,"5min":1.349,"15min":1.349},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.93899999999999995,"15min":0.95199999999999996},"min":{"1min":0.73199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1779999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.872},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.69499999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":1.0049999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.68799999999999994,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.008,"15min":1.022},"min":{"1min":0.82699999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.355,"5min":1.536,"15min":1.536},"last":1.1359999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.417,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3380000000000001,"5min":1.448,"15min":1.448},"last":1.1930000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.125},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.359,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.71299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4890000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1020000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1439999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.385,"5min":1.536,"15min":1.536},"last":1.304},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":1.048,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4990000000000001,"5min":2.194,"15min":2.194},"last":1.333}]}]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1110016,"data_stored":807793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.321,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.194,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96399999999999997,"15min":0.96199999999999997},"min":{"1min":0.77800000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.196,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97199999999999998,"15min":0.98199999999999998},"min":{"1min":0.73599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.258,"5min":2.105,"15min":2.105},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.72899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2909999999999999,"5min":2.153,"15min":2.153},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0649999999999999,"15min":1.095},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1459999999999999,"5min":1.919,"15min":1.919},"last":0.89300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.046},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.2050000000000001},"min":{"1min":0.752,"5min":0.623,"15min":0.623},"max":{"1min":1.2909999999999999,"5min":2.431,"15min":2.431},"last":1.101}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1240000000000001,"15min":1.1519999999999999},"min":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.353,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.169,"15min":1.173},"min":{"1min":0.875,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5329999999999999,"5min":2.04,"15min":2.04},"last":1.1659999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.194},"min":{"1min":0.84399999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.508,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.198},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.248,"15min":1.2769999999999999},"min":{"1min":0.95099999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.419,"5min":2.27,"15min":2.27},"last":1.232}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.93899999999999995,"15min":0.96299999999999997},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.141,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.085},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66300000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.69499999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.85699999999999998},"min":{"1min":0.64900000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1220000000000001,"5min":1.212,"15min":1.212},"last":0.83599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1850000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.0029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":0.93500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0269999999999999,"5min":1.266,"15min":1.266},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2889999999999999,"5min":1.363,"15min":1.363},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2030000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.135,"15min":1.1919999999999999},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.1879999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.1659999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.161,"15min":1.206},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.353,"5min":2.25,"15min":2.25},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.1839999999999999,"15min":1.1970000000000001},"min":{"1min":0.91700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2949999999999999,"5min":1.706,"15min":1.706},"last":1.141}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1830000000000001,"15min":1.238},"min":{"1min":0.80600000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.228,"5min":2.359,"15min":2.359},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5049999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3380000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.37},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.69999999999999996},"min":{"1min":0.624,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.66100000000000003},"min":{"1min":0.502,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.113},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.123,"5min":1.601,"15min":1.601},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0700000000000001,"5min":1.21,"15min":1.21},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.83799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1599999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1850000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.04,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0620000000000001,"15min":1.0609999999999999},"min":{"1min":0.90900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.24,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1160000000000001},"min":{"1min":0.92700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.272,"5min":1.768,"15min":1.768},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.415,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.149,"15min":1.137},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.476,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.77100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.502,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88200000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.093,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.629,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.95999999999999996,"5min":1.173,"15min":1.173},"last":0.625}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.255,"15min":0.255},"max":{"1min":0.92300000000000004,"5min":1.143,"15min":1.143},"last":0.504},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.70099999999999996,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0089999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.96599999999999997},"min":{"1min":0.90000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.534,"15min":1.534},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.018,"15min":0.99399999999999999},"min":{"1min":0.80900000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.0089999999999999},"min":{"1min":0.80300000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4079999999999999,"5min":1.476,"15min":1.476},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.0469999999999999},"min":{"1min":0.85299999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.167,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.048,"15min":1.0720000000000001},"min":{"1min":0.746,"5min":0.502,"15min":0.502},"max":{"1min":1.2709999999999999,"5min":1.823,"15min":1.823},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.91000000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3740000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.109,"15min":1.083},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.437},"max":{"1min":1.4990000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.755},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.98699999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1114112,"data_stored":808804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0880000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.95199999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0649999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.022,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88100000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.016,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.3580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2609999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.81399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2350000000000001,"5min":1.26,"15min":1.26},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.095,"15min":1.1160000000000001},"min":{"1min":0.86599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4330000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.75}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.091,"15min":1.101},"min":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.872},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0980000000000001,"15min":1.109},"min":{"1min":0.89400000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.3500000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.107,"15min":1.1220000000000001},"min":{"1min":0.86399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2809999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1799999999999999,"15min":1.204},"min":{"1min":0.80100000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6359999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.79600000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.70199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56599999999999995,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84899999999999998,"15min":0.84199999999999997},"min":{"1min":0.66500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.823,"15min":1.823},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1040000000000001,"5min":1.367,"15min":1.367},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.96899999999999997},"min":{"1min":0.91800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.86199999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3160000000000001,"5min":1.379,"15min":1.379},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.05,"15min":1.0449999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3420000000000001,"5min":1.768,"15min":1.768},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0900000000000001,"15min":1.093},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3380000000000001,"5min":1.913,"15min":1.913},"last":1.3},{"interface":"front","average":{"1min":1.129,"5min":1.0669999999999999,"15min":1.0449999999999999},"min":{"1min":0.84699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.077}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.087,"15min":1.075},"min":{"1min":0.874,"5min":0.75,"15min":0.75},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1020000000000001,"15min":1.0800000000000001},"min":{"1min":1.0029999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.944,"15min":1.944},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:46.879 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:27:16.664091+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=16, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=30, tm_sec=41, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:30:46.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:31:02.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:02.876 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:06.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:06.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 Processor -- start 2024-08-17T02:31:06.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 -- start start 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa36c159340 0x7fa36c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c0cef40 con 0x7fa36c0cb240 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c0ce330 con 0x7fa36c0cddc0 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c0ad930 con 0x7fa36c159340 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36affd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa36c159340 0x7fa36c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa36c0cb240 0x7fa36c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:38546/0 (socket says 172.21.15.155:38546) 2024-08-17T02:31:06.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36b7fe700 1 -- 172.21.15.155:0/2438061423 learned_addr learned my addr 172.21.15.155:0/2438061423 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36affd700 1 -- 172.21.15.155:0/2438061423 >> v1:172.21.15.189:6789/0 conn(0x7fa36c0cddc0 legacy=0x7fa36c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36affd700 1 -- 172.21.15.155:0/2438061423 >> v1:172.21.15.155:6789/0 conn(0x7fa36c0cb240 legacy=0x7fa36c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa369ffb700 1 -- 172.21.15.155:0/2438061423 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104581705 0 0) 0x7fa36c0ce330 con 0x7fa36c0cddc0 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36affd700 1 -- 172.21.15.155:0/2438061423 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0ce610 con 0x7fa36c159340 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa36affd700 1 --2- 172.21.15.155:0/2438061423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0ad3f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa3540098e0 tx=0x7fa3540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3580eb2c6fd526e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa369ffb700 1 -- 172.21.15.155:0/2438061423 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354009e80 con 0x7fa36c159340 2024-08-17T02:31:06.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa369ffb700 1 -- 172.21.15.155:0/2438061423 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400b760 con 0x7fa36c159340 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa369ffb700 1 -- 172.21.15.155:0/2438061423 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400bae0 con 0x7fa36c159340 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 -- 172.21.15.155:0/2438061423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 msgr2=0x7fa36c0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.992+0000 7fa3712b2700 1 --2- 172.21.15.155:0/2438061423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0ad3f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa3540098e0 tx=0x7fa3540091a0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- 172.21.15.155:0/2438061423 shutdown_connections 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 --2- 172.21.15.155:0/2438061423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0ad3f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- 172.21.15.155:0/2438061423 >> 172.21.15.155:0/2438061423 conn(0x7fa36c0994e0 msgr2=0x7fa36c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- 172.21.15.155:0/2438061423 shutdown_connections 2024-08-17T02:31:06.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- 172.21.15.155:0/2438061423 wait complete. 2024-08-17T02:31:07.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 Processor -- start 2024-08-17T02:31:07.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- start start 2024-08-17T02:31:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0cb240 0x7fa36c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c0cddc0 0x7fa36c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c153410 con 0x7fa36c159340 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c153cb0 con 0x7fa36c0cddc0 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa3712b2700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c16d220 con 0x7fa36c0cb240 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa36b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa36b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59252/0 (socket says 172.21.15.155:59252) 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa36b7fe700 1 -- 172.21.15.155:0/1172495051 learned_addr learned my addr 172.21.15.155:0/1172495051 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa36affd700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0cb240 0x7fa36c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:06.996+0000 7fa36a7fc700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c0cddc0 0x7fa36c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 -- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0cb240 msgr2=0x7fa36c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0cb240 0x7fa36c154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 -- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c0cddc0 msgr2=0x7fa36c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c0cddc0 0x7fa36c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 -- 172.21.15.155:0/1172495051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354009420 con 0x7fa36c159340 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36b7fe700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c810 tx=0x7fa35c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c005b30 con 0x7fa36c159340 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c005c90 con 0x7fa36c159340 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c153660 con 0x7fa36c159340 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c007320 con 0x7fa36c159340 2024-08-17T02:31:07.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c1515d0 con 0x7fa36c159340 2024-08-17T02:31:07.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c0645c0 con 0x7fa36c159340 2024-08-17T02:31:07.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa35c01b3b0 con 0x7fa36c159340 2024-08-17T02:31:07.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 0x7fa34c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa35c07bd10 con 0x7fa36c159340 2024-08-17T02:31:07.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.000+0000 7fa36affd700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 0x7fa34c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.004+0000 7fa36affd700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 0x7fa34c062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3540030c0 tx=0x7fa354016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.012+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa35c04c4c0 con 0x7fa36c159340 2024-08-17T02:31:07.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.172+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 --> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa36c153df0 con 0x7fa34c060890 2024-08-17T02:31:07.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa362ffd700 1 -- 172.21.15.155:0/1172495051 <== mgr.4101 v2:172.21.15.155:6832/24098 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48720 (secure 0 0 0) 0x7fa36c153df0 con 0x7fa34c060890 2024-08-17T02:31:07.179 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:31:07.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 msgr2=0x7fa34c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 0x7fa34c062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3540030c0 tx=0x7fa354016000 comp rx=0 tx=0).stop 2024-08-17T02:31:07.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 msgr2=0x7fa36c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c810 tx=0x7fa35c007ea0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 shutdown_connections 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7fa34c060890 0x7fa34c062d40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c159340 0x7fa36c0d0550 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c0cddc0 0x7fa36c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 --2- 172.21.15.155:0/1172495051 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0cb240 0x7fa36c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 >> 172.21.15.155:0/1172495051 conn(0x7fa36c0994e0 msgr2=0x7fa36c0695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 shutdown_connections 2024-08-17T02:31:07.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.176+0000 7fa3712b2700 1 -- 172.21.15.155:0/1172495051 wait complete. 2024-08-17T02:31:07.183 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-08-17T02:31:07.193 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-08-17T02:31:06.018476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396556,"kb_used_data":5220,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578164,"statfs":{"total":773094113280,"available":770640039936,"internally_reserved":0,"allocated":5345280,"data_stored":2927213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003273"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":196,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:30:55.213519+0000","last_change":"2024-08-17T02:30:55.213444+0000","last_active":"2024-08-17T02:30:55.213519+0000","last_peered":"2024-08-17T02:30:55.213519+0000","last_clean":"2024-08-17T02:30:55.213519+0000","last_became_active":"2024-08-17T02:27:17.680479+0000","last_became_peered":"2024-08-17T02:27:17.680479+0000","last_unstale":"2024-08-17T02:30:55.213519+0000","last_undegraded":"2024-08-17T02:30:55.213519+0000","last_fullsized":"2024-08-17T02:30:55.213519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-08-17T02:30:55.213208+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-08-17T02:30:55.213208+0000","last_clean_scrub_stamp":"2024-08-17T02:30:55.213208+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:43.114247+0000","scrub_duration":0.0098846809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.177,"5min":1.306,"15min":1.306},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.84099999999999997,"15min":0.81699999999999995},"min":{"1min":0.65700000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.82799999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.88900000000000001,"15min":0.85699999999999998},"min":{"1min":0.63800000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.446,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.97799999999999998,"15min":1},"min":{"1min":0.74399999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.335,"5min":1.637,"15min":1.637},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88900000000000001,"15min":0.86899999999999999},"min":{"1min":0.624,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.224,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.88100000000000001,"15min":0.87},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.71699999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.98999999999999999,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92900000000000005,"15min":0.90300000000000002},"min":{"1min":0.70699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.88100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89400000000000002,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.27,"5min":1.276,"15min":1.276},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0089999999999999,"15min":0.997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4810000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.167}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.97199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.397,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.171,"15min":1.157},"min":{"1min":0.88200000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.417,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.1419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.88400000000000001,"15min":0.83499999999999996},"min":{"1min":0.64000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.97499999999999998,"15min":0.96299999999999997},"min":{"1min":0.79000000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.206,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0269999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.63,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88800000000000001},"min":{"1min":0.55500000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2090000000000001,"5min":1.349,"15min":1.349},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.93899999999999995,"15min":0.95199999999999996},"min":{"1min":0.73199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1779999999999999,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.232},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.69499999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.78600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.68799999999999994,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.008,"15min":1.022},"min":{"1min":0.82699999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.355,"5min":1.536,"15min":1.536},"last":1.0700000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.63800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.417,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3380000000000001,"5min":1.448,"15min":1.448},"last":0.86299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.125},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.359,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.139},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.71299999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4890000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.109}]},{"osd":7,"last update":"Sat Aug 17 02:30:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1439999999999999,"15min":1.1719999999999999},"min":{"1min":0.92300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.385,"5min":1.536,"15min":1.536},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.23},"min":{"1min":1.048,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4990000000000001,"5min":2.194,"15min":2.194},"last":1.2769999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1110016,"data_stored":807793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91200000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.67100000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.321,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.194,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.268},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96399999999999997,"15min":0.96199999999999997},"min":{"1min":0.77800000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.196,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.97199999999999998,"15min":0.98199999999999998},"min":{"1min":0.73599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.258,"5min":2.105,"15min":2.105},"last":0.95599999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.72899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2909999999999999,"5min":2.153,"15min":2.153},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0649999999999999,"15min":1.095},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1459999999999999,"5min":1.919,"15min":1.919},"last":1.1779999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.2050000000000001},"min":{"1min":0.752,"5min":0.623,"15min":0.623},"max":{"1min":1.2909999999999999,"5min":2.431,"15min":2.431},"last":1.0029999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1240000000000001,"15min":1.1519999999999999},"min":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.353,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.169,"15min":1.173},"min":{"1min":0.875,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5329999999999999,"5min":2.04,"15min":2.04},"last":1.1299999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.194},"min":{"1min":0.84399999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.508,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.248,"15min":1.2769999999999999},"min":{"1min":0.95099999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.419,"5min":2.27,"15min":2.27},"last":1.421}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.93899999999999995,"15min":0.96299999999999997},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.141,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.284},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.66300000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94899999999999995,"15min":0.95099999999999996},"min":{"1min":0.69499999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.85699999999999998},"min":{"1min":0.64900000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1220000000000001,"5min":1.212,"15min":1.212},"last":0.92000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1850000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.0029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.216}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0269999999999999,"5min":1.266,"15min":1.266},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2889999999999999,"5min":1.363,"15min":1.363},"last":1.03}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2030000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.135,"15min":1.1919999999999999},"min":{"1min":0.84199999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.1879999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.161,"15min":1.206},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.353,"5min":2.25,"15min":2.25},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.1839999999999999,"15min":1.1970000000000001},"min":{"1min":0.91700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2949999999999999,"5min":1.706,"15min":1.706},"last":1.081}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1830000000000001,"15min":1.238},"min":{"1min":0.80600000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.228,"5min":2.359,"15min":2.359},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.99099999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.5049999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72599999999999998,"15min":0.69999999999999996},"min":{"1min":0.624,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68999999999999995,"15min":0.66100000000000003},"min":{"1min":0.502,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.113},"last":0.68100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.123,"5min":1.601,"15min":1.601},"last":0.749}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0700000000000001,"5min":1.21,"15min":1.21},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.83799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1599999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.056}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1850000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.083},{"interface":"front","average":{"1min":1.04,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0620000000000001,"15min":1.0609999999999999},"min":{"1min":0.90900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.24,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.129,"15min":1.1160000000000001},"min":{"1min":0.92700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.272,"5min":1.768,"15min":1.768},"last":1.161}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.415,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.149,"15min":1.137},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.476,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.0249999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.502,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88200000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.59899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.093,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.629,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.95999999999999996,"5min":1.173,"15min":1.173},"last":0.72199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.56100000000000005,"5min":0.255,"15min":0.255},"max":{"1min":0.92300000000000004,"5min":1.143,"15min":1.143},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.70099999999999996,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.0089999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.96599999999999997},"min":{"1min":0.90000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3600000000000001,"5min":1.534,"15min":1.534},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.018,"15min":0.99399999999999999},"min":{"1min":0.80900000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.0089999999999999},"min":{"1min":0.80300000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4079999999999999,"5min":1.476,"15min":1.476},"last":1.145},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.0469999999999999},"min":{"1min":0.85299999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.167,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.048,"15min":1.0720000000000001},"min":{"1min":0.746,"5min":0.502,"15min":0.502},"max":{"1min":1.2709999999999999,"5min":1.823,"15min":1.823},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.91000000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3740000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.101}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.109,"15min":1.083},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.437},"max":{"1min":1.4990000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.044},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.98699999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0629999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1114112,"data_stored":808804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0880000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72699999999999998,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.752}]},{"osd":2,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0649999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.022,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88100000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.016,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.3580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2609999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.997}]},{"osd":5,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.81399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2350000000000001,"5min":1.26,"15min":1.26},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.095,"15min":1.1160000000000001},"min":{"1min":0.86599999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4330000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.89000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.091,"15min":1.101},"min":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0980000000000001,"15min":1.109},"min":{"1min":0.89400000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.3500000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.125}]},{"osd":7,"last update":"Sat Aug 17 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.107,"15min":1.1220000000000001},"min":{"1min":0.86399999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2809999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.23},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1799999999999999,"15min":1.204},"min":{"1min":0.80100000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.6359999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":218436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.70199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.56599999999999995,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.57499999999999996,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84899999999999998,"15min":0.84199999999999997},"min":{"1min":0.66500000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.823,"15min":1.823},"last":0.93100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1040000000000001,"5min":1.367,"15min":1.367},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.96899999999999997},"min":{"1min":0.91800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.86199999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3160000000000001,"5min":1.379,"15min":1.379},"last":1.22},{"interface":"front","average":{"1min":1.069,"5min":1.05,"15min":1.0449999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3420000000000001,"5min":1.768,"15min":1.768},"last":1.175}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0900000000000001,"15min":1.093},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3380000000000001,"5min":1.913,"15min":1.913},"last":1.111},{"interface":"front","average":{"1min":1.129,"5min":1.0669999999999999,"15min":1.0449999999999999},"min":{"1min":0.84699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.137}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.087,"15min":1.075},"min":{"1min":0.874,"5min":0.75,"15min":0.75},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1020000000000001,"15min":1.0800000000000001},"min":{"1min":1.0029999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.456,"5min":1.944,"15min":1.944},"last":1.2709999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:07.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:31:07.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 Processor -- start 2024-08-17T02:31:07.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 -- start start 2024-08-17T02:31:07.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18ac13fa50 0x7f18ac0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0b0810 con 0x7f18ac0ad6c0 2024-08-17T02:31:07.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0afc70 con 0x7f18ac13f680 2024-08-17T02:31:07.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b1558700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0af060 con 0x7f18ac13fa50 2024-08-17T02:31:07.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18ab7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18ac13fa50 0x7f18ac0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b0d57700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f18ac0ad6c0 0x7f18ac06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:38560/0 (socket says 172.21.15.155:38560) 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18b0d57700 1 -- 172.21.15.155:0/82336118 learned_addr learned my addr 172.21.15.155:0/82336118 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18ab7fe700 1 -- 172.21.15.155:0/82336118 >> v1:172.21.15.189:6789/0 conn(0x7f18ac13f680 legacy=0x7f18ac0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18ab7fe700 1 -- 172.21.15.155:0/82336118 >> v1:172.21.15.155:6789/0 conn(0x7f18ac0ad6c0 legacy=0x7f18ac06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.304+0000 7f18ab7fe700 1 -- 172.21.15.155:0/82336118 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0af340 con 0x7f18ac13fa50 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18ab7fe700 1 --2- 172.21.15.155:0/82336118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac0aea80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f18940098e0 tx=0x7f18940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b08d632d62c6e50 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18aaffd700 1 -- 172.21.15.155:0/82336118 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894009e80 con 0x7f18ac13fa50 2024-08-17T02:31:07.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18aaffd700 1 -- 172.21.15.155:0/82336118 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400b860 con 0x7f18ac13fa50 2024-08-17T02:31:07.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18aaffd700 1 -- 172.21.15.155:0/82336118 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400bbe0 con 0x7f18ac13fa50 2024-08-17T02:31:07.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 -- 172.21.15.155:0/82336118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 msgr2=0x7f18ac0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 --2- 172.21.15.155:0/82336118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac0aea80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f18940098e0 tx=0x7f18940091a0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 -- 172.21.15.155:0/82336118 shutdown_connections 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 --2- 172.21.15.155:0/82336118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac0aea80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 -- 172.21.15.155:0/82336118 >> 172.21.15.155:0/82336118 conn(0x7f18ac0678a0 msgr2=0x7f18ac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 -- 172.21.15.155:0/82336118 shutdown_connections 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.308+0000 7f18b1558700 1 -- 172.21.15.155:0/82336118 wait complete. 2024-08-17T02:31:07.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 Processor -- start 2024-08-17T02:31:07.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- start start 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18ac0ad6c0 0x7f18ac132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 0x7f18ac063200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac132d40 con 0x7f18ac13fa50 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac132fe0 con 0x7f18ac0ad6c0 2024-08-17T02:31:07.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac1332c0 con 0x7f18ac13f680 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59270/0 (socket says 172.21.15.155:59270) 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 -- 172.21.15.155:0/2559052468 learned_addr learned my addr 172.21.15.155:0/2559052468 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18abfff700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18ac0ad6c0 0x7f18ac132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18ab7fe700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 0x7f18ac063200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 -- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 msgr2=0x7f18ac063200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 0x7f18ac063200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 -- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18ac0ad6c0 msgr2=0x7f18ac132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18ac0ad6c0 0x7f18ac132800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 -- 172.21.15.155:0/2559052468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009420 con 0x7f18ac13fa50 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18ab7fe700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 0x7f18ac063200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b0d57700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f189c00cc40 tx=0x7f189c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00a910 con 0x7f18ac13fa50 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c00aa70 con 0x7f18ac13fa50 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac1335a0 con 0x7f18ac13fa50 2024-08-17T02:31:07.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00ae30 con 0x7f18ac13fa50 2024-08-17T02:31:07.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.312+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac063740 con 0x7f18ac13fa50 2024-08-17T02:31:07.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac063990 con 0x7f18ac13fa50 2024-08-17T02:31:07.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f189c007300 con 0x7f18ac13fa50 2024-08-17T02:31:07.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18a3fff700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 0x7f188c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18abfff700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 0x7f188c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f189c07ccf0 con 0x7f18ac13fa50 2024-08-17T02:31:07.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.316+0000 7f18abfff700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 0x7f188c062d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f18a4003aa0 tx=0x7f18a4000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.324+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f189c04d3c0 con 0x7f18ac13fa50 2024-08-17T02:31:07.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.488+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f18ac064330 con 0x7f18ac13fa50 2024-08-17T02:31:07.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f189c04d3c0 con 0x7f18ac13fa50 2024-08-17T02:31:07.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18a3fff700 1 -- 172.21.15.155:0/2559052468 <== mon.0 v2:172.21.15.155:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f189c0509e0 con 0x7f18ac13fa50 2024-08-17T02:31:07.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 msgr2=0x7f188c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 0x7f188c062d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f18a4003aa0 tx=0x7f18a4000bc0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 msgr2=0x7f18ac1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f189c00cc40 tx=0x7f189c001a50 comp rx=0 tx=0).stop 2024-08-17T02:31:07.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 shutdown_connections 2024-08-17T02:31:07.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f188c060890 0x7f188c062d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18ac13fa50 0x7f18ac1306a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f18ac13f680 0x7f18ac063200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 --2- 172.21.15.155:0/2559052468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18ac0ad6c0 0x7f18ac132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.496+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 >> 172.21.15.155:0/2559052468 conn(0x7f18ac0678a0 msgr2=0x7f18ac13e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.500+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 shutdown_connections 2024-08-17T02:31:07.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.500+0000 7f18b1558700 1 -- 172.21.15.155:0/2559052468 wait complete. 2024-08-17T02:31:07.518 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:31:07.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:07.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 Processor -- start 2024-08-17T02:31:07.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- start start 2024-08-17T02:31:07.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d1415d540 0x7f6d140af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6d1406e830 0x7f6d140a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d140b0270 con 0x7f6d140a9260 2024-08-17T02:31:07.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140af660 con 0x7f6d1415d540 2024-08-17T02:31:07.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140af940 con 0x7f6d1406e830 2024-08-17T02:31:07.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d1415d540 0x7f6d140af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d1415d540 0x7f6d140af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59282/0 (socket says 172.21.15.155:59282) 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 -- 172.21.15.155:0/603786601 learned_addr learned my addr 172.21.15.155:0/603786601 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1933f700 1 --2- 172.21.15.155:0/603786601 >> v2:172.21.15.189:3300/0 conn(0x7f6d1406e830 0x7f6d140a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 -- 172.21.15.155:0/603786601 >> v2:172.21.15.189:3300/0 conn(0x7f6d1406e830 msgr2=0x7f6d140a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 --2- 172.21.15.155:0/603786601 >> v2:172.21.15.189:3300/0 conn(0x7f6d1406e830 0x7f6d140a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d18b3e700 1 -- 172.21.15.155:0/603786601 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637250324 0 0) 0x7f6d140b0270 con 0x7f6d140a9260 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 -- 172.21.15.155:0/603786601 >> v1:172.21.15.155:6789/0 conn(0x7f6d140a9260 legacy=0x7f6d140b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 -- 172.21.15.155:0/603786601 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d140afc20 con 0x7f6d1415d540 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d19b40700 1 --2- 172.21.15.155:0/603786601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1415d540 0x7f6d140af030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d1406c970 tx=0x7f6d04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb9ad4d7189178 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d18b3e700 1 -- 172.21.15.155:0/603786601 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04009e70 con 0x7f6d1415d540 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d18b3e700 1 -- 172.21.15.155:0/603786601 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d0400b860 con 0x7f6d1415d540 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d18b3e700 1 -- 172.21.15.155:0/603786601 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400bc20 con 0x7f6d1415d540 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- 172.21.15.155:0/603786601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1415d540 msgr2=0x7f6d140af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/603786601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1415d540 0x7f6d140af030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d1406c970 tx=0x7f6d04009250 comp rx=0 tx=0).stop 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- 172.21.15.155:0/603786601 shutdown_connections 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/603786601 >> v2:172.21.15.189:3300/0 conn(0x7f6d1406e830 0x7f6d140a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/603786601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1415d540 0x7f6d140af030 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- 172.21.15.155:0/603786601 >> 172.21.15.155:0/603786601 conn(0x7f6d14066e00 msgr2=0x7f6d14067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- 172.21.15.155:0/603786601 shutdown_connections 2024-08-17T02:31:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.624+0000 7f6d1bda4700 1 -- 172.21.15.155:0/603786601 wait complete. 2024-08-17T02:31:07.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 Processor -- start 2024-08-17T02:31:07.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- start start 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d140a9260 0x7f6d1416d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 0x7f6d1416da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14171140 con 0x7f6d1406e830 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14170b10 con 0x7f6d140a9260 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1416e040 con 0x7f6d1415d540 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59294/0 (socket says 172.21.15.155:59294) 2024-08-17T02:31:07.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 -- 172.21.15.155:0/1352046579 learned_addr learned my addr 172.21.15.155:0/1352046579 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1933f700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d140a9260 0x7f6d1416d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1a341700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 0x7f6d1416da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 -- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 msgr2=0x7f6d1416da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 0x7f6d1416da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 -- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d140a9260 msgr2=0x7f6d1416d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d140a9260 0x7f6d1416d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 -- 172.21.15.155:0/1352046579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040094f0 con 0x7f6d1406e830 2024-08-17T02:31:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1a341700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 0x7f6d1416da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d19b40700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6d040090b0 tx=0x7f6d04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400bbe0 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d0401f070 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1416e320 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040266f0 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.628+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d141575c0 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d140645c0 con 0x7f6d1406e830 2024-08-17T02:31:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6d0401a430 con 0x7f6d1406e830 2024-08-17T02:31:07.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d09ffb700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 0x7f6cf8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6d04021070 con 0x7f6d1406e830 2024-08-17T02:31:07.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d1933f700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 0x7f6cf8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.632+0000 7f6d1933f700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 0x7f6cf8062d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d1406e750 tx=0x7f6d1000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.640+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6d0404eec0 con 0x7f6d1406e830 2024-08-17T02:31:07.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d1406f360 con 0x7f6d1406e830 2024-08-17T02:31:07.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d09ffb700 1 -- 172.21.15.155:0/1352046579 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6d04015090 con 0x7f6d1406e830 2024-08-17T02:31:07.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-08-17T02:31:07.851 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/914650219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":914650219},{"type":"v1","addr":"172.21.15.189:6833","nonce":914650219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3408243715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3408243715},{"type":"v1","addr":"172.21.15.155:6835","nonce":3408243715}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5277,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/477170548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":477170548},{"type":"v1","addr":"172.21.15.155:6837","nonce":477170548}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1499081834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1499081834},{"type":"v1","addr":"172.21.15.189:6835","nonce":1499081834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2024-08-17T02:31:07.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 msgr2=0x7f6cf8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 0x7f6cf8062d40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d1406e750 tx=0x7f6d1000b040 comp rx=0 tx=0).stop 2024-08-17T02:31:07.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 msgr2=0x7f6d14157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6d040090b0 tx=0x7f6d04009250 comp rx=0 tx=0).stop 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 shutdown_connections 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:6832/24098,v1:172.21.15.155:6833/24098] conn(0x7f6cf8060890 0x7f6cf8062d40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6d1415d540 0x7f6d1416da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d140a9260 0x7f6d1416d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 --2- 172.21.15.155:0/1352046579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1406e830 0x7f6d14157080 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.848+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 >> 172.21.15.155:0/1352046579 conn(0x7f6d14066e00 msgr2=0x7f6d140671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.852+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 shutdown_connections 2024-08-17T02:31:07.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-08-17T02:31:07.852+0000 7f6d1bda4700 1 -- 172.21.15.155:0/1352046579 wait complete. 2024-08-17T02:31:07.856 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 22 2024-08-17T02:31:07.870 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:31:07.871 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:31:07.871 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:31:07.871 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:07.883 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:31:07.884 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:31:07.884 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:07.898 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:31:07.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:31:07.898 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:07.914 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:31:07.914 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:31:07.915 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:07.971 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:31:07.971 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:31:07.971 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.034 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:31:08.035 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:31:08.035 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.111 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:31:08.111 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:31:08.111 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.183 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:31:08.183 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:31:08.183 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.257 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:31:08.258 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:31:08.258 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.356 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:31:08.356 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:31:08.356 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.421 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:31:08.421 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:31:08.421 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.499 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:31:08.499 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:31:08.499 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.568 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:31:08.577 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:31:08.578 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:31:08.578 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.612 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:31:08.612 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:31:08.612 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.640 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:31:08.640 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:31:08.640 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:31:08.641 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.673 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:31:08.673 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:31:08.673 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.692 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:31:08.692 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:31:08.692 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:08.754 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:31:08.754 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:31:08.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:31:08.777 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:31:08.778 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:31:09.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:31:09.173 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:31:09.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:31:09.397 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:31:09.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:31:09.598 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:31:09.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:31:09.773 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:31:09.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:31:09.991 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:31:10.208 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:31:10.209 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:31:10.401 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:31:10.401 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:31:10.569 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:31:10.570 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/data/mon.a.tgz 2024-08-17T02:31:10.570 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-08-17T02:31:10.577 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.8zwrmbWP5n 2024-08-17T02:31:10.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8zwrmbWP5n 2024-08-17T02:31:10.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.8zwrmbWP5n 2024-08-17T02:31:10.679 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.8zwrmbWP5n is 310KB 2024-08-17T02:31:10.740 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.8zwrmbWP5n 2024-08-17T02:31:10.746 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/data/mon.b.tgz 2024-08-17T02:31:10.746 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-08-17T02:31:10.753 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.BP1ZwWik4t 2024-08-17T02:31:10.754 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BP1ZwWik4t 2024-08-17T02:31:10.857 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.BP1ZwWik4t 2024-08-17T02:31:10.883 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.BP1ZwWik4t is 410KB 2024-08-17T02:31:10.945 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.BP1ZwWik4t 2024-08-17T02:31:10.952 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/data/mon.c.tgz 2024-08-17T02:31:10.952 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-08-17T02:31:10.959 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.lGo4fKnd8X 2024-08-17T02:31:10.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lGo4fKnd8X 2024-08-17T02:31:11.105 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.lGo4fKnd8X 2024-08-17T02:31:11.126 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.lGo4fKnd8X is 410KB 2024-08-17T02:31:11.185 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.lGo4fKnd8X 2024-08-17T02:31:11.191 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:31:11.191 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:11.194 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:11.207 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:31:11.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:11.209 DEBUG:teuthology.orchestra.run.smithi189:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:11.234 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:11.236 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:11.242 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:31:11.244 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi155/crash 2024-08-17T02:31:11.244 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:11.306 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi189/crash 2024-08-17T02:31:11.307 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:11.323 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:31:11.323 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.375 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.389 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.405 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:31:11.405 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:11.435 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:11.466 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30565.log 2024-08-17T02:31:11.466 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29100.log 2024-08-17T02:31:11.467 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32403.log 2024-08-17T02:31:11.467 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34191.log 2024-08-17T02:31:11.468 INFO:teuthology.orchestra.run.smithi155.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30565.log.gz 2024-08-17T02:31:11.468 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29100.log: /var/log/ceph/ceph-client.0.32403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30020.log 2024-08-17T02:31:11.468 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29100.log.gz 2024-08-17T02:31:11.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30397.log 2024-08-17T02:31:11.469 INFO:teuthology.orchestra.run.smithi155.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34191.log.gz 2024-08-17T02:31:11.469 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30020.log: --verbose -- /var/log/ceph/ceph-client.admin.33282.log 2024-08-17T02:31:11.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31848.log 2024-08-17T02:31:11.470 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30020.log.gz 2024-08-17T02:31:11.470 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33444.log 2024-08-17T02:31:11.470 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33282.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30397.log.gz 2024-08-17T02:31:11.471 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30625.log 2024-08-17T02:31:11.471 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33282.log.gz 2024-08-17T02:31:11.472 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24298.log 2024-08-17T02:31:11.473 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:31:11.473 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33444.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31848.log.gz 2024-08-17T02:31:11.473 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-08-17T02:31:11.473 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30625.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33444.log.gz 2024-08-17T02:31:11.473 INFO:teuthology.orchestra.run.smithi155.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.32403.log.gz 2024-08-17T02:31:11.474 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-08-17T02:31:11.474 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.a.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30625.log.gz 2024-08-17T02:31:11.474 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.31165.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31233.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.24298.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24247.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.24298.log.gz--verbose 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr:-- /var/log/ceph/ceph-client.admin.24222.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.24247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29980.log 2024-08-17T02:31:11.479 INFO:teuthology.orchestra.run.smithi189.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.24247.log.gz 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.24222.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.1.29980.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24222.log.gz 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.audit.log: 95.3% -- replaced with /var/log/ceph/ceph-client.1.29980.log.gz 2024-08-17T02:31:11.480 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29702.log 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.6.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.1.29702.log: 89.0% -- replaced with /var/log/ceph/ceph-client.1.29702.log.gz 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24272.log 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24325.log 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.b.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:31:11.495 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.24272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.29815.log 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24272.log.gz/var/log/ceph/ceph-client.admin.24325.log: 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24352.log 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24325.log.gz 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.3.29815.log: /var/log/ceph/ceph-client.admin.24352.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24352.log.gz 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.3.29815.log.gz 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24380.log 2024-08-17T02:31:11.496 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24408.log 2024-08-17T02:31:11.497 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.24380.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24380.log.gz 2024-08-17T02:31:11.497 INFO:teuthology.orchestra.run.smithi189.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:11.497 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:31:11.497 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.24408.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24408.log.gz 2024-08-17T02:31:11.502 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.7.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29885.log 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31530.log 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31233.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-08-17T02:31:11.506 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29885.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31233.log.gz 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29019.log 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29885.log.gz 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31530.log.gz 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28851.log 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32481.log: /var/log/ceph/ceph-client.admin.29019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29019.log.gz 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28770.log 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-08-17T02:31:11.507 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31084.log 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29154.log 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28770.log: /var/log/ceph/ceph-client.admin.31084.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.28851.log.gz-5 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:--verbose -- /var/log/ceph/ceph-client.admin.32937.log 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31084.log.gz 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29154.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28770.log.gz 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29235.log 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29154.log.gz 2024-08-17T02:31:11.508 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34108.log 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30182.log 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32937.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29235.log.gz 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32132.log 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34108.log.gz 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32937.log.gz 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32132.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19226.log 2024-08-17T02:31:11.509 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32132.log.gz 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.tmp-client.admin.19226.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.30182.log.gz 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31657.log 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19226.log.gz 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.31057.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28965.log 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31657.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-08-17T02:31:11.510 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34081.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34027.log 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31657.log.gz 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28965.log.gz 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34027.log.gz 2024-08-17T02:31:11.511 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33811.log 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30841.log 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31929.log 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33811.log: /var/log/ceph/ceph-client.admin.30841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31557.log 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33811.log.gz 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30841.log.gz-5 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:--verbose -- /var/log/ceph/ceph-client.admin.29181.log 2024-08-17T02:31:11.512 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32562.log 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31929.log.gz 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32535.log 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31557.log.gz 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29181.log.gz 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28909.log 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32535.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32562.log.gz 2024-08-17T02:31:11.513 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30760.log 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30128.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32535.log.gz 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28909.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28909.log.gz 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33072.log 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29371.log 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30760.log.gz 2024-08-17T02:31:11.514 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.33072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33471.log 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29208.log 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33072.log.gz 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29371.log.gz 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33471.log.gz 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29358.log 2024-08-17T02:31:11.515 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29208.log: /var/log/ceph/ceph-client.admin.33757.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29208.log.gz 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31902.log 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29358.log: /var/log/ceph/ceph-client.admin.31794.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29358.log.gz 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30814.log 2024-08-17T02:31:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31902.log: /var/log/ceph/ceph-client.admin.33676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29289.log 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31902.log.gz 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30814.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30814.log.gz 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33784.log 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29289.log: /var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33552.log 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29289.log.gz 2024-08-17T02:31:11.517 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33784.log: /var/log/ceph/ceph-client.admin.33552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32345.log 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33784.log.gz 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33552.log.gz 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.32345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29579.log 2024-08-17T02:31:11.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34243.log 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32991.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32345.log.gz 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29579.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29579.log.gz 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28992.log 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.34243.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31138.log 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28992.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.32775.log 2024-08-17T02:31:11.519 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34243.log.gz 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31287.log 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31138.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28992.log.gz 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32775.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31138.log.gz 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31287.log.gz 2024-08-17T02:31:11.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29587.log 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30598.log 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31958.log 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29587.log: /var/log/ceph/ceph-client.admin.30598.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.29587.log.gz 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.30047.log 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30598.log.gz 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31341.log 2024-08-17T02:31:11.521 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24218.log 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30047.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31958.log.gz 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30047.log.gz 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.24218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32593.log 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31341.log.gz 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24218.log.gzgzip 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-08-17T02:31:11.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29364.log 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32593.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33593.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32593.log.gz 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32078.log 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31821.log 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32856.log 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29364.log.gz 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30155.log 2024-08-17T02:31:11.523 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.32856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32454.log 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31821.log.gz 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32856.log.gz 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.30489.log 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30155.log.gz 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31422.log 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32454.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.32454.log.gz-5 2024-08-17T02:31:11.524 INFO:teuthology.orchestra.run.smithi155.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30976.log 2024-08-17T02:31:11.525 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.2.30489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-08-17T02:31:11.525 INFO:teuthology.orchestra.run.smithi189.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31422.log: /var/log/ceph/ceph-client.admin.30976.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31422.log.gz 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.2.30489.log.gz 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30538.log 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log: /var/log/ceph/ceph-client.admin.31003.log 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32213.log 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-08-17T02:31:11.556 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29993.log 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30538.log.gz 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29583.log 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32213.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31003.log.gz 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28674.log 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32213.log.gz 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29583.log: /var/log/ceph/ceph-client.admin.32721.log 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29993.log.gz 2024-08-17T02:31:11.557 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3%/var/log/ceph/ceph-client.admin.28674.log: -- replaced with /var/log/ceph/ceph-client.admin.29583.log.gz 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31111.log 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28674.log.gz 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32721.log: /var/log/ceph/ceph-client.admin.30652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24355.log 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33145.log 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31111.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-08-17T02:31:11.558 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.24355.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31368.log 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31111.log.gz 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.33145.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28880.log 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24355.log.gz 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31368.log: /var/log/ceph/ceph-client.admin.32910.log 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33145.log.gz 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28880.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31368.log.gz 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:31:11.559 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32910.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28880.log.gz 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31987.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose /var/log/ceph/ceph-osd.1.log: -- /var/log/ceph/ceph-client.admin.29804.log 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31260.log 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7%/var/log/ceph/ceph-client.admin.31260.log: -- replaced with /var/log/ceph/ceph-client.admin.29804.log.gz 2024-08-17T02:31:11.560 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31260.log.gz 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30101.log 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32022.log 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29369.log 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30101.log.gz 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29912.log 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29365.log 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29369.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32022.log.gz 2024-08-17T02:31:11.561 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29912.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28938.log 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29369.log.gz 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29912.log.gz 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30238.log 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33973.log 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28938.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29365.log.gz 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30238.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29584.log 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30238.log.gz 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28938.log.gz 2024-08-17T02:31:11.562 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33973.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33973.log.gz 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32620.log 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29584.log: /var/log/ceph/ceph-client.admin.33622.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29584.log.gz 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32647.log 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32647.log: /var/log/ceph/ceph-client.admin.34162.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32620.log.gz 2024-08-17T02:31:11.563 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32647.log.gz 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gz 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33417.log 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31503.log: /var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31875.log 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33255.log 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2024-08-17T02:31:11.564 INFO:teuthology.orchestra.run.smithi155.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33417.log: /var/log/ceph/ceph-client.admin.31875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29262.log 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31875.log.gz 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33417.log.gz/var/log/ceph/ceph-client.admin.33255.log: 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31314.log 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33255.log.gz 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31684.log 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29262.log.gz 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-08-17T02:31:11.565 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31314.log.gz 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31684.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29366.log 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32508.log 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31684.log.gz 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32883.log 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29366.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29370.log 2024-08-17T02:31:11.566 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32508.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29366.log.gz 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30922.log 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0%/var/log/ceph/ceph-client.admin.32883.log: -- replaced with /var/log/ceph/ceph-client.admin.32508.log.gz 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29858.log 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29370.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32883.log.gz 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30350.log 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30922.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29370.log.gz 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33703.log 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29858.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30922.log.gz 2024-08-17T02:31:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.0.30350.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29858.log.gz 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32105.log 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33018.log 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31449.log: /var/log/ceph/ceph-client.admin.32105.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.30350.log.gz 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30787.log 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32105.log.gz 2024-08-17T02:31:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33498.log 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30787.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33018.log.gz 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29046.log 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30787.log.gz 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33649.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33498.log.gz 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33336.log 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30074.log 2024-08-17T02:31:11.569 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31767.log 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29046.log.gz 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30074.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33336.log.gz 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29316.log 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30074.log.gz 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31767.log: /var/log/ceph/ceph-client.admin.29316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30895.log 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31767.log.gz 2024-08-17T02:31:11.570 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29316.log.gz 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28797.log 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29580.log 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30895.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29367.log 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30895.log.gz 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30949.log 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29580.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28797.log.gz 2024-08-17T02:31:11.571 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31030.log 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29367.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29580.log.gz 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32748.log 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30949.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29367.log.gz 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30868.log 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31030.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30949.log.gz 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30733.log 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32748.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31030.log.gz 2024-08-17T02:31:11.572 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30679.log 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32748.log.gz 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30733.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30868.log.gz 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30679.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30733.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31206.log 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33946.log: 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30679.log.gz 2024-08-17T02:31:11.573 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.31206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29939.log 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.0.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31206.log.gz 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29585.log 2024-08-17T02:31:11.574 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33390.log 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29939.log: /var/log/ceph/ceph-client.admin.29585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29585.log.gz 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29939.log.gz 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29966.log 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32159.log 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33390.log: /var/log/ceph/ceph-client.admin.29966.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33390.log.gz 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29966.log.gz 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34135.log 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28737.log 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29586.log 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34135.log: -- replaced with /var/log/ceph/ceph-client.admin.32159.log.gz 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28737.log: /var/log/ceph/ceph-client.admin.33892.log 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34135.log.gz 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29586.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28737.log.gz 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29586.log.gz 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29127.log 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32829.log 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29575.log 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33892.log.gz 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32829.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29127.log.gz 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33525.log 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29575.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32829.log.gz 2024-08-17T02:31:11.577 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29775.log 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33525.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29575.log.gz 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.3.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33525.log.gzgzip 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32240.log 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33865.log 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32186.log 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32240.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29775.log.gz 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33919.log 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32240.log.gz 2024-08-17T02:31:11.578 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33865.log.gz 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32186.log.gz 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33309.log 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34000.log 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33309.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33919.log.gz 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33309.log.gz 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28572.log 2024-08-17T02:31:11.579 INFO:teuthology.orchestra.run.smithi155.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34000.log: /var/log/ceph/ceph-client.admin.34216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34000.log.gz 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29831.log 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34054.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28572.log.gz 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30706.log 2024-08-17T02:31:11.580 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.32294.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29831.log.gz 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33730.log 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.30706.log: /var/log/ceph/ceph-client.admin.33730.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30706.log.gz 2024-08-17T02:31:11.581 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33730.log.gz 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33228.log 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28824.log 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24092.log 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28824.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29073.log 2024-08-17T02:31:11.583 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33228.log.gz 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.24092.log: -- replaced with /var/log/ceph/ceph-client.admin.28824.log.gz 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29073.log: /var/log/ceph/ceph-osd.2.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.24092.log.gz 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29073.log.gz 2024-08-17T02:31:11.584 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33199.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-08-17T02:31:11.591 INFO:teuthology.orchestra.run.smithi189.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:31:11.604 INFO:teuthology.orchestra.run.smithi189.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:31:11.617 INFO:teuthology.orchestra.run.smithi189.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:31:11.659 INFO:teuthology.orchestra.run.smithi189.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:31:11.663 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:31:11.674 INFO:teuthology.orchestra.run.smithi189.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:31:11.676 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-08-17T02:31:11.676 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m0.224s 2024-08-17T02:31:11.676 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m0.977s 2024-08-17T02:31:11.676 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.051s 2024-08-17T02:31:11.697 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:31:11.699 INFO:teuthology.orchestra.run.smithi155.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:31:11.708 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:31:11.742 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:31:11.751 INFO:teuthology.orchestra.run.smithi155.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:31:11.753 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-08-17T02:31:11.753 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.315s 2024-08-17T02:31:11.753 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m1.253s 2024-08-17T02:31:11.753 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.095s 2024-08-17T02:31:11.753 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:31:11.753 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi155/log 2024-08-17T02:31:11.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:12.059 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi189/log 2024-08-17T02:31:12.060 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:12.202 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:31:12.225 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:31:12.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:12.227 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:12.292 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:31:12.301 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:31:12.301 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:12.304 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:12.327 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:31:12.327 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-08-17T02:31:12.328 INFO:teuthology.orchestra.run.smithi155.stdout:*hv01.front.sepi 67.205.162.81 3 u 43 64 177 0.062 0.622 0.277 2024-08-17T02:31:12.328 INFO:teuthology.orchestra.run.smithi155.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 64 177 0.064 0.466 0.161 2024-08-17T02:31:12.328 INFO:teuthology.orchestra.run.smithi155.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 177 0.090 0.393 0.315 2024-08-17T02:31:12.328 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:31:12.329 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:31:12.329 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-08-17T02:31:12.329 INFO:teuthology.orchestra.run.smithi189.stdout:+hv01.front.sepi 67.205.162.81 3 u 37 64 177 0.083 0.406 0.334 2024-08-17T02:31:12.329 INFO:teuthology.orchestra.run.smithi189.stdout:*hv02.front.sepi 63.231.80.2 3 u 42 64 177 0.086 0.840 0.417 2024-08-17T02:31:12.330 INFO:teuthology.orchestra.run.smithi189.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 177 0.100 0.367 0.310 2024-08-17T02:31:12.330 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:31:12.330 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:31:12.339 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:31:12.340 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:31:12.348 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:31:12.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:31:12.365 INFO:teuthology.task.internal:Duration was 774.767038 seconds 2024-08-17T02:31:12.365 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:31:12.378 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:31:12.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:12.381 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:12.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:31:12.430 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-08-17T02:31:12.430 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:12.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-08-17T02:31:12.442 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:12.452 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:31:12.452 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:12.454 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:12.489 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:31:12.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:12.531 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:12.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:31:12.617 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:31:12.618 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:12.634 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:12.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:31:12.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:12.660 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:12.673 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-08-17T02:31:12.674 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-08-17T02:31:12.690 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:12.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:12.739 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:12.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:12.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:31:12.754 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:31:12.755 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi155 2024-08-17T02:31:12.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:12.780 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858256/remote/smithi189 2024-08-17T02:31:12.780 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:12.805 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:31:12.806 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:12.808 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:12.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:31:12.824 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:31:12.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:31:12.836 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:31:12.836 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:12.855 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:12.860 INFO:teuthology.orchestra.run.smithi155.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:12.863 INFO:teuthology.orchestra.run.smithi189.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:12.865 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:31:12.874 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:31:12.896 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 774.7670383453369 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=07e09af21e634c6b9d20216fe6edc440 status: fail success: false 2024-08-17T02:31:12.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:31:12.983 INFO:teuthology.run:FAIL